Sep 01 01:52:26 devstack cinder-volume[75826]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:52:26 devstack cinder-volume[75826]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:52:26 devstack cinder-volume[75826]: we strongly recommend against using it for new projects. Sep 01 01:52:26 devstack cinder-volume[75826]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:52:26 devstack cinder-volume[75826]: framework. For more detail see Sep 01 01:52:26 devstack cinder-volume[75826]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:52:26 devstack cinder-volume[75826]: import eventlet # noqa Sep 01 01:52:29 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:52:29 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:52:29 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:52:30 devstack cinder-volume[75826]: INFO dbcounter [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Registered counter for database cinder Sep 01 01:52:30 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:52:30 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writer thread running {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:52:30 devstack cinder-volume[75826]: INFO cinder.rpc [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:52:30 devstack cinder-volume[75826]: INFO cinder.rpc [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:52:30 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:52:30 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Determined volume DB was empty at startup. Sep 01 01:52:30 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75826) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:52:30 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:52:30 devstack cinder-volume[75826]: WARNING stevedore.named [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:52:30 devstack cinder-volume[75826]: WARNING castellan.key_manager [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:52:30 devstack cinder-volume[75826]: WARNING cinder.keymgr.conf_key_mgr [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:52:30 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75826) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 01:52:30 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] CMD "cinder-rtstool verify" returned: 0 in 0.398s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:52:31 devstack cinder-volume[75826]: INFO cinder.rpc [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 01:52:31 devstack cinder-volume[75826]: INFO cinder.rpc [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 01:52:31 devstack cinder-volume[75826]: WARNING stevedore.named [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:52:31 devstack cinder-volume[75826]: WARNING castellan.key_manager [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:52:31 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:52:31 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Starting 1 workers Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Started child 75970 {{(pid=75826) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Full set of CONF: {{(pid=75826) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:52:31 devstack cinder-volume[75970]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Configuration options gathered from: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] ================================================================================ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] allow_availability_zone_fallback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] allow_compression_on_image_upload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] allowed_direct_url_schemes = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] api_rate_limit = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] auth_strategy = keystone {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] az_cache_duration = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_host = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_stats_polling_interval = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backup_api_class = cinder.backup.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backup_name_template = backup-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backup_use_same_host = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backup_use_temp_snapshot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] chap_username = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_internal_tenant_project_id = 6af6e4b66c534c4798d11c7b319dac08 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_internal_tenant_user_id = c352d9b2d6a8478588741dec0b0b5109 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cloned_volume_same_az = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cluster = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] compression_format = gzip {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] compute_api_class = cinder.compute.nova.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] config_dir = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] config_source = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] control_exchange = openstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] debug = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] default_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] default_group_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] default_volume_type = lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] driver_ssl_cert_verify = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] driver_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] enable_force_upload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] enable_new_services = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] enable_unsupported_driver = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] enforce_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_api_insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_api_servers = ['http://192.168.122.45/image'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_api_ssl_compression = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_ca_certificates_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_catalog_info = image:glance:publicURL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_num_retries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance_request_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] graceful_shutdown_timeout = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] group_api_class = cinder.group.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] host = devstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_compress_on_upload = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_conversion_address_space_limit = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_conversion_cpu_limit = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_conversion_disable = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_upload_use_cinder_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_upload_use_internal_tenant = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_volume_cache_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_volume_cache_max_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] image_volume_cache_max_size_gb = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] init_host_max_objects_retrieval = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] instance_format = [instance: %(uuid)s] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] iscsi_target_flags = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75970]: INFO cinder.volume.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] iscsi_write_cache = on {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] iser_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] iser_ip_address = 192.168.122.45 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] iser_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_color = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_config_append = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_dir = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_options = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_rotate_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_rotate_interval_type = days {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] log_rotation_type = none {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] max_age = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] max_logfile_count = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] max_logfile_size_mb = 200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] max_over_subscription_ratio = 20.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] message_reap_interval = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] message_ttl = 2592000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] migration_create_volume_timeout_secs = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] monkey_patch = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] monkey_patch_modules = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] my_ip = 192.168.122.45 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] no_snapshot_gb_quota = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] num_iser_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] num_shell_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] num_volume_device_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] nvmeof_conn_info_version = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] nvmet_ns_id = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] nvmet_port_id = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_max_limit = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_volume_ext_list = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_volume_listen_port = 8776 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_volume_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] osapi_volume_workers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] per_volume_size_limit = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] periodic_fuzzy_delay = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] periodic_interval = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] public_endpoint = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] publish_errors = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_backup_gigabytes = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_backups = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_gigabytes = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_groups = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_snapshots = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] quota_volumes = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] rate_limit_burst = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] rate_limit_except_level = CRITICAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] rate_limit_interval = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] reinit_driver_count = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] report_discard_supported = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] report_interval = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] reservation_clean_interval = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] reservation_expire = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] reserved_image_namespaces = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] reserved_percentage = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] rpc_response_timeout = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] run_external_periodic_tasks = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] scst_target_driver = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_down_time = 720 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] shell_completion = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] snapshot_name_template = snapshot-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] snapshot_same_host = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] state_path = /opt/stack/data/cinder {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] storage_availability_zone = nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] storage_protocol = iSCSI {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] syslog_log_facility = LOG_USER {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] target_helper = lioadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] target_ip_address = 192.168.122.45 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] target_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] target_secondary_ip_addresses = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] trace_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] transport_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] until_refresh = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_chap_auth = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_default_quota_class = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_journal = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_json = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_stderr = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] use_syslog = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] verify_glance_signatures = enabled {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_api_class = cinder.volume.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_clear = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_clear_size = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_copy_bps_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_dd_blocksize = 1M {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_name_template = volume-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_service_inithost_offload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volume_usage_audit_period = month {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] zoning_mode = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_concurrency.disable_process_locking = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.auth_type = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.auth_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.cache = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.include_service_catalog = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.interface = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack sudo[75976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 01:52:31 devstack sudo[75976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcache_username = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.service_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.45/identity {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.backend = dogpile.cache.null {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.backend_argument = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.backend_expiration_time = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.config_prefix = cache.oslo {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.debug_cache_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.enable_retry_client = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.enable_socket_keepalive = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.expiration_time = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.hashclient_retry_attempts = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_dead_retry = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_pool_maxsize = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_sasl_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.proxies = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.redis_db = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.redis_server = localhost:6379 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.retry_attempts = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.retry_delay = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.socket_keepalive_count = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.socket_keepalive_idle = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.socket_keepalive_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.socket_timeout = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.tls_allowed_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.tls_cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.tls_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.tls_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.tls_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cache.username = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] coordination.backend_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.asyncio_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.asyncio_slave_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.backend = sqlalchemy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.connection_debug = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.connection_parameters = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.connection_recycle_time = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.connection_trace = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.db_inc_retry_interval = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.db_max_retries = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.db_max_retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.db_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.max_overflow = 50 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.max_pool_size = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.max_retries = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.mysql_wsrep_sync_wait = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.pool_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.slave_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.sqlite_synchronous = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.synchronous_reader = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] database.use_db_reconnect = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_tracing.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.connection_string = messaging:// {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.es_doc_type = notification {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.es_scroll_size = 10000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.es_scroll_time = 2m {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.filter_error_trace = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.hmac_keys = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.socket_timeout = 0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.trace_requests = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler.trace_sqlalchemy = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler_jaeger.process_tags = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler_jaeger.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] profiler_otlp.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.enforce_new_defaults = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.policy_default_rule = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.policy_file = policy.yaml {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.group = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] privsep_osbrick.user = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.group = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] cinder_sys_admin.user = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.auth_type = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.send_service_user_token = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] service_user.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.auth_type = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] glance.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.chap_username = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.driver_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.extra_capabilities = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.iscsi_target_flags = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.iscsi_write_cache = on {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.iser_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.iser_ip_address = 192.168.122.45 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.iser_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.lvm_share_target = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.lvm_type = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.num_shell_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.report_discard_supported = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.reserved_percentage = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.target_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.target_ip_address = 192.168.122.45 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.target_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.trace_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.unique_fqdn_network = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.use_chap_auth = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_clear = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_clear_size = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_reports.file_event_handler = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_reports.log_dir = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.backend_host = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.chap_username = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.extra_capabilities = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.iser_helper = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.iser_ip_address = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.iser_port = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.lvm_share_target = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.lvm_type = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.num_shell_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.report_discard_supported = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.reserved_percentage = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.scst_target_driver = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.storage_protocol = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.target_helper = lioadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.target_ip_address = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.target_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.trace_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.use_chap_auth = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_clear = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_clear_size = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] lvmdriver-1.volumes_dir = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_notifications.driver = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_notifications.retry = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] key_manager.fixed_key = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.barbican_api_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.barbican_endpoint = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.barbican_endpoint_type = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.barbican_region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.number_of_retries = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.retry_delay = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.send_service_user_token = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.verify_ssl = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican.verify_ssl_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.auth_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] barbican_service_user.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.approle_role_id = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.approle_secret_id = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.auth_method = approle {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.auth_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.kv_mountpoint = secret {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.kv_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.kv_version = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.root_token_id = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.ssl_ca_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.timeout = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.token_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.token_role = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:52:31 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:52:32 devstack sudo[75976]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack sudo[75979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:32 devstack sudo[75979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:32 devstack sudo[75979]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.354s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:52:32 devstack cinder-volume[75970]: INFO cinder.brick.local_dev.lvm [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack sudo[76066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:52:32 devstack sudo[76066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:32 devstack sudo[76066]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG cinder.brick.local_dev.lvm [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75970) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 01:52:32 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack sudo[76176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:32 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:33 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.545s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack sudo[76383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:33 devstack sudo[76383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:33 devstack sudo[76383]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack sudo[76472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 01:52:33 devstack sudo[76472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:33 devstack sudo[76472]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.280s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:52:33 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:34 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:34 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:34 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:34 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:52:34 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:34 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:34 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:34 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:34 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:34 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:34 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:34 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:34 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:34 devstack sudo[76682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:34 devstack sudo[76682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:35 devstack sudo[76682]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:35 devstack sudo[76692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:35 devstack sudo[76692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:35 devstack sudo[76692]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:35 devstack cinder-volume[75970]: INFO cinder.volume.drivers.lvm [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:35 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:35 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:35 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG cinder.volume.drivers.lvm [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Updating volume stats {{(pid=75970) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:52:35 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:35 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:52:35 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:35 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:36 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:36 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:36 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:36 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:36 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:36 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:36 devstack sudo[76794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:36 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:36 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:36 devstack cinder-volume[75970]: INFO cinder.volume.driver [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG cinder.volume.driver [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75970) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_db.sqlalchemy.engines [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writer thread running {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG cinder.db.api [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Building query based on filter {{(pid=75970) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG cinder.image.image_utils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75970) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:52:36 devstack cinder-volume[75970]: INFO cinder.keymgr.migration [None req-9ecd0ba6-5eac-4fb3-aed3-5dd444ec9fdd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG cinder.volume.drivers.lvm [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Updating volume stats {{(pid=75970) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:52:36 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:36 devstack sudo[76798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:52:36 devstack sudo[76798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:37 devstack sudo[76798]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:37 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:37 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:37 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:37 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:37 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:37 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:37 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:37 devstack sudo[76807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:37 devstack sudo[76807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:37 devstack sudo[76807]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:37 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:37 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:37 devstack sudo[76810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:37 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:38 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG cinder.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Notifying Schedulers of capabilities ... {{(pid=75970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:38 devstack cinder-volume[75970]: INFO cinder.volume.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Driver initialization completed successfully. Sep 01 01:52:38 devstack cinder-volume[75970]: INFO cinder.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Initiating service 2 cleanup Sep 01 01:52:38 devstack cinder-volume[75970]: INFO cinder.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Service 2 cleanup completed. Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG cinder.service [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Creating RPC server for service cinder-volume {{(pid=75970) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG cinder.service [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75970) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:52:38 devstack cinder-volume[75970]: INFO cinder.volume.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG cinder.volume.drivers.lvm [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Updating volume stats {{(pid=75970) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:38 devstack sudo[76813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:52:38 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:38 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:38 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:38 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:38 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:38 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:38 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:52:38 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:39 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:39 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:39 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:39 devstack sudo[76824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:52:39 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:39 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:39 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:39 devstack cinder-volume[75970]: INFO cinder.volume.manager [None req-f23ff737-769b-421a-8525-6b813bc270bd None None] Driver post RPC initialization completed successfully. Sep 01 01:52:41 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:46 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:49 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:53:24 devstack cinder-volume[75970]: DEBUG oslo_service.periodic_task [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running periodic task VolumeManager._thread_info {{(pid=75970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:53:24 devstack cinder-volume[75970]: DEBUG cinder.volume.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] thread count: 6 {{(pid=75970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:53:24 devstack cinder-volume[75970]: DEBUG cinder.volume.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] thread info: [<_MainThread(MainThread, started 135030941876352)>, , , , , ] {{(pid=75970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG oslo_service.periodic_task [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG cinder.volume.drivers.lvm [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Updating volume stats {{(pid=75970) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:24 devstack sudo[82051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:24 devstack sudo[82051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:24 devstack sudo[82051]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:24 devstack sudo[82054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:24 devstack sudo[82054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:24 devstack sudo[82054]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:24 devstack sudo[82057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:24 devstack sudo[82057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:25 devstack sudo[82057]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:25 devstack sudo[82060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:25 devstack sudo[82060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:25 devstack sudo[82060]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG cinder.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Notifying Schedulers of capabilities ... {{(pid=75970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG oslo_service.periodic_task [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running periodic task VolumeManager._thread_info {{(pid=75970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG cinder.volume.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] thread count: 6 {{(pid=75970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:54:25 devstack cinder-volume[75970]: DEBUG cinder.volume.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] thread info: [<_MainThread(MainThread, started 135030941876352)>, , , , , ] {{(pid=75970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:54:49 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writing DB stats cinder:SELECT=1 {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:49 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writing DB stats cinder:UPDATE=1 {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG oslo_service.periodic_task [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG cinder.volume.drivers.lvm [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Updating volume stats {{(pid=75970) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:24 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:24 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:24 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:24 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:24 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:24 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:24 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:24 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:25 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:25 devstack sudo[83987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:25 devstack sudo[83987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:25 devstack sudo[83987]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG cinder.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Notifying Schedulers of capabilities ... {{(pid=75970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG oslo_service.periodic_task [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running periodic task VolumeManager._thread_info {{(pid=75970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG cinder.volume.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] thread count: 6 {{(pid=75970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:55:25 devstack cinder-volume[75970]: DEBUG cinder.volume.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] thread info: [<_MainThread(MainThread, started 135030941876352)>, , , , , ] {{(pid=75970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG oslo_service.periodic_task [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG cinder.volume.drivers.lvm [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Updating volume stats {{(pid=75970) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:24 devstack sudo[85451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:56:24 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:24 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:24 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:56:24 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:24 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:24 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:24 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:56:24 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:25 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:25 devstack sudo[85461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:56:25 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:25 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:25 devstack cinder-volume[75970]: DEBUG oslo_concurrency.processutils [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:25 devstack cinder-volume[75970]: DEBUG cinder.manager [None req-0b031603-00ec-409b-86bf-5a399cfeacda None None] Notifying Schedulers of capabilities ... {{(pid=75970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:49 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writing DB stats cinder:SELECT=1 {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:49 devstack cinder-volume[75970]: DEBUG dbcounter [-] [75970] Writing DB stats cinder:UPDATE=1 {{(pid=75970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:13 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Caught SIGTERM, stopping children Sep 01 01:57:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:57:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:57:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:57:13 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Stop services. {{(pid=75826) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:57:13 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Killing children. {{(pid=75826) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:57:13 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Waiting on 1 children to exit Sep 01 01:57:18 devstack cinder-volume[75970]: DEBUG oslo_concurrency.lockutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Acquiring lock "singleton_lock" {{(pid=75970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:57:18 devstack cinder-volume[75970]: DEBUG oslo_concurrency.lockutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Acquired lock "singleton_lock" {{(pid=75970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:57:18 devstack cinder-volume[75970]: DEBUG oslo_concurrency.lockutils [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Releasing lock "singleton_lock" {{(pid=75970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:57:18 devstack cinder-volume[75970]: WARNING amqp [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:57:18 devstack cinder-volume[75970]: WARNING amqp [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:57:18 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-11c54995-5b23-4aa1-ab50-8a42b74e7925 None None] Child 75970 exited with status 0 Sep 01 01:57:18 devstack cinder-volume[86427]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:57:18 devstack cinder-volume[86427]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:57:18 devstack cinder-volume[86427]: we strongly recommend against using it for new projects. Sep 01 01:57:18 devstack cinder-volume[86427]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:57:18 devstack cinder-volume[86427]: framework. For more detail see Sep 01 01:57:18 devstack cinder-volume[86427]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:57:18 devstack cinder-volume[86427]: import eventlet # noqa Sep 01 01:57:20 devstack cinder-volume[86427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:57:20 devstack cinder-volume[86427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:57:20 devstack cinder-volume[86427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:57:21 devstack cinder-volume[86427]: INFO dbcounter [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Registered counter for database cinder Sep 01 01:57:21 devstack cinder-volume[86427]: DEBUG oslo_db.sqlalchemy.engines [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG dbcounter [-] [86427] Writer thread running {{(pid=86427) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:57:22 devstack cinder-volume[86427]: INFO cinder.rpc [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:57:22 devstack cinder-volume[86427]: INFO cinder.rpc [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_db.sqlalchemy.engines [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:22 devstack cinder-volume[86427]: INFO cinder.volume.manager [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Determined volume DB was empty at startup. Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG cinder.volume.manager [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86427) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:57:22 devstack cinder-volume[86427]: INFO cinder.volume.manager [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:57:22 devstack cinder-volume[86427]: WARNING stevedore.named [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:57:22 devstack cinder-volume[86427]: WARNING castellan.key_manager [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:57:22 devstack cinder-volume[86427]: WARNING cinder.keymgr.conf_key_mgr [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:57:22 devstack cinder-volume[86427]: INFO cinder.volume.manager [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_db.sqlalchemy.engines [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86427) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:22 devstack cinder-volume[86427]: INFO oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Starting 1 workers Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Started child 86679 {{(pid=86427) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Full set of CONF: {{(pid=86427) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] ******************************************************************************** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Configuration options gathered from: {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] ================================================================================ {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] allow_availability_zone_fallback = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] allow_compression_on_image_upload = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] allowed_direct_url_schemes = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86679]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] api_rate_limit = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] auth_strategy = keystone {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_availability_zone = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_host = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_stats_polling_interval = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backup_api_class = cinder.backup.api.API {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backup_name_template = backup-%s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backup_use_same_host = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backup_use_temp_snapshot = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] chap_password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] chap_username = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_internal_tenant_project_id = 6af6e4b66c534c4798d11c7b319dac08 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_internal_tenant_user_id = c352d9b2d6a8478588741dec0b0b5109 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cluster = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] compression_format = gzip {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] compute_api_class = cinder.compute.nova.API {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] config_dir = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] config_source = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] control_exchange = openstack {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] debug = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] default_availability_zone = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] default_group_type = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] default_volume_type = QuobyteHD {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] disk_geometry = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] driver_client_cert = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] driver_client_cert_key = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] driver_data_namespace = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] driver_ssl_cert_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] driver_ssl_cert_verify = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] driver_use_ssl = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] enable_new_services = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] enable_unsupported_driver = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] enabled_backends = ['QuobyteHD'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] enforce_multipath_for_image_xfer = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] filter_function = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_api_insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_api_servers = ['http://192.168.122.45/image'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_api_ssl_compression = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_ca_certificates_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_catalog_info = image:glance:publicURL {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.remotefs [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86679) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_num_retries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance_request_timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] goodness_function = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] graceful_shutdown_timeout = 5 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] group_api_class = cinder.group.api.API {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] host = devstack {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_compress_on_upload = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_conversion_address_space_limit = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_conversion_cpu_limit = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_conversion_disable = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_upload_use_cinder_backend = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_upload_use_internal_tenant = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_volume_cache_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_volume_cache_max_count = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] image_volume_cache_max_size_gb = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] init_host_max_objects_retrieval = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] instance_format = [instance: %(uuid)s] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] iscsi_target_flags = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] iscsi_write_cache = on {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] iser_helper = tgtadm {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] iser_ip_address = 192.168.122.45 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] iser_port = 3260 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_color = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_config_append = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_dir = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_options = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_rotate_interval = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_rotate_interval_type = days {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] log_rotation_type = none {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] max_age = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] max_logfile_count = 30 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] max_logfile_size_mb = 200 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] max_over_subscription_ratio = 20.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] message_reap_interval = 86400 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] message_ttl = 2592000 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] migration_create_volume_timeout_secs = 300 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] monkey_patch = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] monkey_patch_modules = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] my_ip = 192.168.122.45 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] no_snapshot_gb_quota = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] num_iser_scan_tries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] num_shell_tries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] num_volume_device_scan_tries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] nvmeof_conn_info_version = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86679) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:57:22 devstack cinder-volume[86679]: WARNING cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:57:22 devstack cinder-volume[86679]: WARNING cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] nvmet_ns_id = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] nvmet_port_id = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_max_limit = 1000 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_volume_ext_list = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Running cmd (subprocess): mount.quobyte {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_volume_listen_port = 8776 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_volume_use_ssl = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] osapi_volume_workers = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] per_volume_size_limit = -1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] periodic_fuzzy_delay = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] periodic_interval = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] public_endpoint = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] publish_errors = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_backup_gigabytes = 1000 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_backups = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_gigabytes = 1000 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_groups = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_snapshots = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] quota_volumes = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] rate_limit_burst = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] rate_limit_except_level = CRITICAL {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] rate_limit_interval = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] reinit_driver_count = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] replication_device = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] report_discard_supported = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] report_interval = 120 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] reservation_clean_interval = 86400 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] reservation_expire = 86400 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] reserved_image_namespaces = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] reserved_percentage = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] rpc_response_timeout = 120 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] run_external_periodic_tasks = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] scst_target_driver = iscsi {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] scst_target_iqn_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_down_time = 720 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] shell_completion = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] snapshot_name_template = snapshot-%s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] split_loggers = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] state_path = /opt/stack/data/cinder {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] storage_availability_zone = nova {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] storage_protocol = iSCSI {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] syslog_log_facility = LOG_USER {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] target_helper = lioadm {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] target_ip_address = 192.168.122.45 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] target_port = 3260 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] target_protocol = iscsi {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] target_secondary_ip_addresses = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] trace_flags = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] transport_url = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] until_refresh = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_chap_auth = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_default_quota_class = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_journal = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_json = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_multipath_for_image_xfer = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_stderr = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] use_syslog = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] verify_glance_signatures = enabled {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_api_class = cinder.volume.api.API {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_backend_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_clear = zero {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_clear_ionice = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_clear_size = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_copy_bps_limit = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_dd_blocksize = 1M {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_name_template = volume-%s {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_service_inithost_offload = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volume_usage_audit_period = month {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] zoning_mode = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_concurrency.disable_process_locking = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.auth_section = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.auth_type = password {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.auth_version = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.cache = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.include_service_catalog = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.interface = public {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcache_username = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.region_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.service_type = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.45/identity {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.backend = dogpile.cache.null {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.backend_argument = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.backend_expiration_time = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.config_prefix = cache.oslo {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.debug_cache_backend = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.enable_retry_client = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.enable_socket_keepalive = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.expiration_time = 600 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.hashclient_retry_attempts = 2 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_dead_retry = 300 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_pool_maxsize = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_sasl_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.proxies = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.redis_db = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.redis_server = localhost:6379 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.retry_attempts = 2 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.retry_delay = 0.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.socket_keepalive_count = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.socket_keepalive_idle = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.socket_keepalive_interval = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.socket_timeout = 1.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.tls_allowed_ciphers = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.tls_cafile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.tls_certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.tls_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.tls_keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cache.username = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] coordination.backend_url = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.asyncio_connection = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.asyncio_slave_connection = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.backend = sqlalchemy {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.connection = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.connection_debug = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.connection_parameters = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.connection_recycle_time = 3600 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.connection_trace = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.db_inc_retry_interval = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.db_max_retries = 20 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack quobyte-client[86691]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:57:22 devstack quobyte-client[86691]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.db_max_retry_interval = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.db_retry_interval = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.max_overflow = 50 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.max_pool_size = 5 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.max_retries = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.mysql_wsrep_sync_wait = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.pool_timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.retry_interval = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.slave_connection = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.sqlite_synchronous = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.synchronous_reader = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] database.use_db_reconnect = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] CMD "mount.quobyte" returned: 1 in 0.148s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_tracing.insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.connection_string = messaging:// {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.es_doc_type = notification {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.es_scroll_size = 10000 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.es_scroll_time = 2m {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.filter_error_trace = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.hmac_keys = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.sentinel_service_name = mymaster {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.socket_timeout = 0.1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.trace_requests = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86679]: INFO cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 ... Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler.trace_sqlalchemy = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be -c /etc/quobyte/client-cinder.cfg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler_jaeger.process_tags = {} {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler_jaeger.service_name_prefix = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] profiler_otlp.service_name_prefix = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.enforce_new_defaults = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.policy_default_rule = default {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.policy_file = policy.yaml {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.group = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.helper_command = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] privsep_osbrick.user = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.group = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.helper_command = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] cinder_sys_admin.user = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.auth_section = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.auth_type = password {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.cafile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.collect_timing = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.send_service_user_token = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.split_loggers = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] service_user.timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.auth_section = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.auth_type = password {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.collect_timing = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.region_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.split_loggers = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] glance.timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.backend_availability_zone = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.chap_password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.chap_username = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.disk_geometry = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.driver_client_cert = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.driver_client_cert_key = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.driver_data_namespace = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.driver_use_ssl = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.extra_capabilities = {} {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.filter_function = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.goodness_function = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.iscsi_target_flags = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.iscsi_write_cache = on {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.iser_helper = tgtadm {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.iser_ip_address = 192.168.122.45 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.iser_port = 3260 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_host = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_login = admin {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_mount_options = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_private_key = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_share_path = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.num_shell_tries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.quobyte_volume_url = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.replication_device = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.report_discard_supported = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.reserved_percentage = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.target_helper = tgtadm {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.target_ip_address = 192.168.122.45 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.target_port = 3260 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.target_protocol = iscsi {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.trace_flags = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.unique_fqdn_network = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.use_chap_auth = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_backend_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be -c /etc/quobyte/client-cinder.cfg Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_clear = zero {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_clear_ionice = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_clear_size = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_reports.file_event_handler = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_reports.log_dir = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.backend_availability_zone = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.backend_host = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.chap_password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.chap_username = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.chiscsi_conf = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.disk_geometry = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.driver_client_cert = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.driver_data_namespace = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.driver_use_ssl = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.extra_capabilities = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.filter_function = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.goodness_function = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.iser_helper = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.iser_ip_address = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.iser_port = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.iser_target_prefix = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_host = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_login = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_mount_options = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_password = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_private_key = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_share_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_ssh_port = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.num_shell_tries = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.nvmet_port_id = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.replication_device = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.report_discard_supported = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.reserved_percentage = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.scst_target_driver = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.storage_protocol = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.target_helper = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.target_ip_address = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.target_port = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.target_prefix = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.target_protocol = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.trace_flags = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.use_chap_auth = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_clear = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_clear_size = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] QuobyteHD.volumes_dir = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_notifications.driver = [] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_notifications.retry = -1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] key_manager.fixed_key = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.barbican_api_version = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.barbican_endpoint = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.barbican_endpoint_type = public {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.barbican_region_name = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.cafile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.collect_timing = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.number_of_retries = 60 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.retry_delay = 1 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.send_service_user_token = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.split_loggers = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.verify_ssl = True {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican.verify_ssl_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.auth_section = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.auth_type = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.cafile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.certfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.collect_timing = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.insecure = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.keyfile = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.split_loggers = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] barbican_service_user.timeout = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.approle_role_id = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.approle_secret_id = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.auth_method = approle {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.auth_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.kv_mountpoint = secret {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.kv_path = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.kv_version = 2 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.namespace = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.root_token_id = **** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.ssl_ca_crt_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.timeout = 60.0 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.token_file = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.token_role = None {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.use_ssl = False {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:22 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] ******************************************************************************** {{(pid=86427) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:57:23 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.477s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:23 devstack cinder-volume[86679]: INFO cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 succeeded Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.494s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:23 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:57:23 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:23 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.285s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:23 devstack cinder-volume[86679]: INFO cinder.volume.driver [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.volume.driver [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0434684753418, 'free_capacity_gb': 1774.0434684753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86679) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_db.sqlalchemy.engines [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86679) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG dbcounter [-] [86679] Writer thread running {{(pid=86679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.db.api [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Building query based on filter {{(pid=86679) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.image.image_utils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86679) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:57:23 devstack cinder-volume[86679]: INFO cinder.keymgr.migration [None req-45021fb1-194b-4564-8423-58cdc8615c91 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:23 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:57:23 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:23 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.240s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:23 devstack cinder-volume[86679]: DEBUG cinder.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Notifying Schedulers of capabilities ... {{(pid=86679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:24 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Driver initialization completed successfully. Sep 01 01:57:24 devstack cinder-volume[86679]: INFO cinder.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Initiating service 3 cleanup Sep 01 01:57:24 devstack cinder-volume[86679]: INFO cinder.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Service 3 cleanup completed. Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG cinder.service [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Creating RPC server for service cinder-volume {{(pid=86679) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG cinder.service [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86679) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:57:24 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:24 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:57:24 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:24 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:24 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.285s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:24 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-a55bc136-82c2-4971-9131-561292bd8525 None None] Driver post RPC initialization completed successfully. Sep 01 01:57:28 devstack cinder-volume[86427]: INFO oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Caught SIGTERM, stopping children Sep 01 01:57:28 devstack cinder-volume[86427]: DEBUG oslo_concurrency.lockutils [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Acquiring lock "singleton_lock" {{(pid=86427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:57:28 devstack cinder-volume[86427]: DEBUG oslo_concurrency.lockutils [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Acquired lock "singleton_lock" {{(pid=86427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:57:28 devstack cinder-volume[86427]: DEBUG oslo_concurrency.lockutils [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Releasing lock "singleton_lock" {{(pid=86427) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:57:28 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Stop services. {{(pid=86427) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:57:28 devstack cinder-volume[86427]: DEBUG oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Killing children. {{(pid=86427) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:57:28 devstack cinder-volume[86427]: INFO oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Waiting on 1 children to exit Sep 01 01:57:32 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Acquiring lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:57:32 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Acquired lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:57:32 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Releasing lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:57:32 devstack cinder-volume[86679]: WARNING amqp [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:57:32 devstack cinder-volume[86679]: WARNING amqp [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:57:32 devstack cinder-volume[86427]: INFO oslo_service.backend._eventlet.service [None req-af832547-9142-48b9-92f2-1d41805a6b44 None None] Child 86679 exited with status 0 Sep 01 01:57:33 devstack cinder-volume[87110]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:57:33 devstack cinder-volume[87110]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:57:33 devstack cinder-volume[87110]: we strongly recommend against using it for new projects. Sep 01 01:57:33 devstack cinder-volume[87110]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:57:33 devstack cinder-volume[87110]: framework. For more detail see Sep 01 01:57:33 devstack cinder-volume[87110]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:57:33 devstack cinder-volume[87110]: import eventlet # noqa Sep 01 01:57:36 devstack cinder-volume[87110]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:57:36 devstack cinder-volume[87110]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:57:36 devstack cinder-volume[87110]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:57:37 devstack cinder-volume[87110]: INFO dbcounter [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Registered counter for database cinder Sep 01 01:57:37 devstack cinder-volume[87110]: DEBUG oslo_db.sqlalchemy.engines [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:37 devstack cinder-volume[87110]: DEBUG dbcounter [-] [87110] Writer thread running {{(pid=87110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:57:37 devstack cinder-volume[87110]: INFO cinder.rpc [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:57:37 devstack cinder-volume[87110]: INFO cinder.rpc [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:57:37 devstack cinder-volume[87110]: DEBUG oslo_db.sqlalchemy.engines [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:38 devstack cinder-volume[87110]: INFO cinder.volume.manager [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Determined volume DB was empty at startup. Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG cinder.volume.manager [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87110) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:57:38 devstack cinder-volume[87110]: WARNING stevedore.named [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:57:38 devstack cinder-volume[87110]: WARNING castellan.key_manager [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:57:38 devstack cinder-volume[87110]: WARNING cinder.keymgr.conf_key_mgr [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:57:38 devstack cinder-volume[87110]: INFO cinder.volume.manager [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_db.sqlalchemy.engines [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:38 devstack cinder-volume[87110]: INFO oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Starting 1 workers Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Started child 87404 {{(pid=87110) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Full set of CONF: {{(pid=87110) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] ******************************************************************************** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] Configuration options gathered from: {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] ================================================================================ {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] allow_availability_zone_fallback = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] allow_compression_on_image_upload = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] allowed_direct_url_schemes = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] api_rate_limit = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] auth_strategy = keystone {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_availability_zone = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_host = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_stats_polling_interval = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87404]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backup_api_class = cinder.backup.api.API {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backup_name_template = backup-%s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backup_use_same_host = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backup_use_temp_snapshot = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] chap_password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] chap_username = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_internal_tenant_project_id = 6af6e4b66c534c4798d11c7b319dac08 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_internal_tenant_user_id = c352d9b2d6a8478588741dec0b0b5109 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cluster = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] compression_format = gzip {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] compute_api_class = cinder.compute.nova.API {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] config_dir = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] config_source = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] control_exchange = openstack {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] debug = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] default_availability_zone = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] default_group_type = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] default_volume_type = QuobyteHD {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] disk_geometry = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] driver_client_cert = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] driver_client_cert_key = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] driver_data_namespace = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] driver_ssl_cert_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] driver_ssl_cert_verify = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] driver_use_ssl = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] enable_new_services = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] enable_unsupported_driver = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] enabled_backends = ['QuobyteHD'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] enforce_multipath_for_image_xfer = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] filter_function = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_api_insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_api_servers = ['http://192.168.122.45/image'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_api_ssl_compression = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_ca_certificates_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_catalog_info = image:glance:publicURL {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_num_retries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance_request_timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] goodness_function = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] graceful_shutdown_timeout = 5 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] group_api_class = cinder.group.api.API {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] host = devstack {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_compress_on_upload = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_conversion_address_space_limit = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_conversion_cpu_limit = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_conversion_disable = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_upload_use_cinder_backend = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_upload_use_internal_tenant = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_volume_cache_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_volume_cache_max_count = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] image_volume_cache_max_size_gb = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] init_host_max_objects_retrieval = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] instance_format = [instance: %(uuid)s] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] iscsi_target_flags = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] iscsi_write_cache = on {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] iser_helper = tgtadm {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] iser_ip_address = 192.168.122.45 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] iser_port = 3260 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_color = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_config_append = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_dir = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_options = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_rotate_interval = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_rotate_interval_type = days {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] log_rotation_type = none {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] max_age = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] max_logfile_count = 30 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] max_logfile_size_mb = 200 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] max_over_subscription_ratio = 20.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] message_reap_interval = 86400 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] message_ttl = 2592000 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] migration_create_volume_timeout_secs = 300 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] monkey_patch = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] monkey_patch_modules = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] my_ip = 192.168.122.45 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] no_snapshot_gb_quota = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] num_iser_scan_tries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] num_shell_tries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] num_volume_device_scan_tries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] nvmeof_conn_info_version = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] nvmet_ns_id = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] nvmet_port_id = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_max_limit = 1000 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_volume_ext_list = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_volume_listen_port = 8776 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_volume_use_ssl = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] osapi_volume_workers = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] per_volume_size_limit = -1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] periodic_fuzzy_delay = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] periodic_interval = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] public_endpoint = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] publish_errors = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87404) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_backup_gigabytes = 1000 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_backups = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_gigabytes = 1000 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_groups = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_snapshots = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] quota_volumes = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] rate_limit_burst = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] rate_limit_except_level = CRITICAL {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] rate_limit_interval = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] reinit_driver_count = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] replication_device = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] report_discard_supported = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] report_interval = 120 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] reservation_clean_interval = 86400 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] reservation_expire = 86400 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] reserved_image_namespaces = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] reserved_percentage = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] rpc_response_timeout = 120 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] run_external_periodic_tasks = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] scst_target_driver = iscsi {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] scst_target_iqn_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_down_time = 720 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] shell_completion = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] snapshot_name_template = snapshot-%s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] split_loggers = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] state_path = /opt/stack/data/cinder {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] storage_availability_zone = nova {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] storage_protocol = iSCSI {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] syslog_log_facility = LOG_USER {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] target_helper = lioadm {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] target_ip_address = 192.168.122.45 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] target_port = 3260 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] target_protocol = iscsi {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] target_secondary_ip_addresses = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] trace_flags = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] transport_url = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] until_refresh = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_chap_auth = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_default_quota_class = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_journal = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_json = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_multipath_for_image_xfer = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_stderr = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] use_syslog = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] verify_glance_signatures = enabled {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_api_class = cinder.volume.api.API {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_backend_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_clear = zero {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_clear_ionice = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_clear_size = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_copy_bps_limit = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_dd_blocksize = 1M {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_name_template = volume-%s {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_service_inithost_offload = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volume_usage_audit_period = month {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] zoning_mode = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_concurrency.disable_process_locking = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.auth_section = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.auth_type = password {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.auth_version = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.cache = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.include_service_catalog = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.interface = public {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcache_username = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.region_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.service_type = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.45/identity {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.backend = dogpile.cache.null {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.backend_argument = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.backend_expiration_time = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.config_prefix = cache.oslo {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.debug_cache_backend = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.enable_retry_client = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.enable_socket_keepalive = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.expiration_time = 600 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.hashclient_retry_attempts = 2 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_dead_retry = 300 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_pool_maxsize = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_sasl_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.proxies = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.redis_db = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87404) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.redis_server = localhost:6379 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.retry_attempts = 2 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.retry_delay = 0.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.socket_keepalive_count = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.socket_keepalive_idle = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.socket_keepalive_interval = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.socket_timeout = 1.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.tls_allowed_ciphers = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Running cmd (subprocess): mount.quobyte {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.tls_cafile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.tls_certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.tls_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.tls_keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cache.username = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] coordination.backend_url = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.asyncio_connection = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.asyncio_slave_connection = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.backend = sqlalchemy {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.connection = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.connection_debug = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.connection_parameters = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.connection_recycle_time = 3600 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.connection_trace = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.db_inc_retry_interval = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.db_max_retries = 20 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.db_max_retry_interval = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.db_retry_interval = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.max_overflow = 50 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.max_pool_size = 5 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.max_retries = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.mysql_wsrep_sync_wait = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.pool_timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.retry_interval = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.slave_connection = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.sqlite_synchronous = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.synchronous_reader = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] database.use_db_reconnect = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_tracing.insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.connection_string = messaging:// {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.es_doc_type = notification {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.es_scroll_size = 10000 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.es_scroll_time = 2m {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.filter_error_trace = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.hmac_keys = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.sentinel_service_name = mymaster {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.socket_timeout = 0.1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.trace_requests = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler.trace_sqlalchemy = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler_jaeger.process_tags = {} {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler_jaeger.service_name_prefix = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] profiler_otlp.service_name_prefix = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.enforce_new_defaults = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.policy_default_rule = default {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.policy_file = policy.yaml {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.group = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.helper_command = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] privsep_osbrick.user = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.group = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.helper_command = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] cinder_sys_admin.user = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.auth_section = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.auth_type = password {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.cafile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.collect_timing = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.send_service_user_token = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.split_loggers = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] service_user.timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.auth_section = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.auth_type = password {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.collect_timing = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.region_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.split_loggers = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] glance.timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.backend_availability_zone = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.chap_password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.chap_username = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.disk_geometry = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.driver_client_cert = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.driver_client_cert_key = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.driver_data_namespace = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.driver_use_ssl = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.extra_capabilities = {} {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.filter_function = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.goodness_function = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.iscsi_target_flags = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.iscsi_write_cache = on {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.iser_helper = tgtadm {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.iser_ip_address = 192.168.122.45 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.iser_port = 3260 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_host = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_login = admin {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_mount_options = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_private_key = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_share_path = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.num_shell_tries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack quobyte-client[87408]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack quobyte-client[87408]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.quobyte_volume_url = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.replication_device = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.report_discard_supported = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.reserved_percentage = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.target_helper = tgtadm {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.target_ip_address = 192.168.122.45 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.target_port = 3260 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.target_protocol = iscsi {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.trace_flags = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.unique_fqdn_network = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.use_chap_auth = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_backend_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_clear = zero {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_clear_ionice = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_clear_size = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_reports.file_event_handler = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_reports.log_dir = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.backend_availability_zone = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.backend_host = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.chap_password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.chap_username = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.chiscsi_conf = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.disk_geometry = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.driver_client_cert = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.driver_data_namespace = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.driver_use_ssl = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.extra_capabilities = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.filter_function = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.goodness_function = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.iser_helper = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.iser_ip_address = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.iser_port = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.iser_target_prefix = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_host = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_login = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_mount_options = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_password = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_private_key = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_share_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_ssh_port = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.num_shell_tries = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.nvmet_port_id = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.replication_device = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.report_discard_supported = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.reserved_percentage = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.scst_target_driver = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.storage_protocol = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.target_helper = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.target_ip_address = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.target_port = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.target_prefix = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.target_protocol = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.trace_flags = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.use_chap_auth = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_clear = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_clear_size = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] QuobyteHD.volumes_dir = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_notifications.driver = [] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_notifications.retry = -1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] key_manager.fixed_key = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.barbican_api_version = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.barbican_endpoint = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.barbican_endpoint_type = public {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.barbican_region_name = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.cafile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.collect_timing = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.number_of_retries = 60 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.retry_delay = 1 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.send_service_user_token = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.split_loggers = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.verify_ssl = True {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican.verify_ssl_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.auth_section = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.auth_type = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.cafile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.certfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.collect_timing = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.insecure = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.keyfile = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.split_loggers = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] barbican_service_user.timeout = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.approle_role_id = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.approle_secret_id = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.auth_method = approle {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.auth_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.kv_mountpoint = secret {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.kv_path = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.kv_version = 2 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.namespace = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.root_token_id = **** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.ssl_ca_crt_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.timeout = 60.0 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.token_file = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.token_role = None {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.use_ssl = False {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:57:38 devstack cinder-volume[87110]: DEBUG oslo_service.backend._eventlet.service [None req-33224431-4650-47b8-8a20-6111ae95c46f None None] ******************************************************************************** {{(pid=87110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:57:38 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87404]: INFO cinder.volume.driver [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.driver [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0434684753418, 'free_capacity_gb': 1774.0434684753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87404) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_db.sqlalchemy.engines [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writer thread running {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.db.api [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Building query based on filter {{(pid=87404) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87404) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack cinder-volume[87404]: INFO cinder.keymgr.migration [None req-1adb1442-0308-45e9-97b8-0f967fccef31 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:57:38 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:57:38 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:39 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.239s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Driver initialization completed successfully. Sep 01 01:57:39 devstack cinder-volume[87404]: INFO cinder.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Initiating service 3 cleanup Sep 01 01:57:39 devstack cinder-volume[87404]: INFO cinder.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Service 3 cleanup completed. Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG cinder.service [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Creating RPC server for service cinder-volume {{(pid=87404) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG cinder.service [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87404) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:57:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:39 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:57:39 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:39 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-587e8e4c-aabc-4893-8890-1435c510fa4f None None] Driver post RPC initialization completed successfully. Sep 01 01:57:48 devstack cinder-volume[87110]: DEBUG dbcounter [-] [87110] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:49 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:49 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 6 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:58:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Flow 'volume_create_manager' (c4156c9c-ee4c-478a-977c-0a971bf1d38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f83bbe-9efc-4f60-8c60-023340f1478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f83bbe-9efc-4f60-8c60-023340f1478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1041289309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fe9307-e4d7-4538-bf3a-cc7bc03ca226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac06df4814594467a6678b8d1fed1941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:36Z,use_quota=True,user_id='9c60d671cfc74bd3811a5be6229feff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967843fc-4f90-4931-8989-5b55d0d9ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967843fc-4f90-4931-8989-5b55d0d9ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297eab5f-76cb-4815-9fe8-b705e256cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297eab5f-76cb-4815-9fe8-b705e256cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fe9307-e4d7-4538-bf3a-cc7bc03ca226', 'volume_name': 'volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb5431d-c8dc-4aeb-b763-89e78251bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb5431d-c8dc-4aeb-b763-89e78251bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75599313-bb2b-4e6e-96cf-43ea562ce7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Volume 58fe9307-e4d7-4538-bf3a-cc7bc03ca226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226', 'volume_size': 1} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1041289309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fe9307-e4d7-4538-bf3a-cc7bc03ca226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac06df4814594467a6678b8d1fed1941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:36Z,use_quota=True,user_id='9c60d671cfc74bd3811a5be6229feff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Creating volume 58fe9307-e4d7-4538-bf3a-cc7bc03ca226 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:36 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 01:58:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:36 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 1073741824 Sep 01 01:58:36 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 1073741824" returned: 0 in 0.674s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 Sep 01 01:58:37 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226" returned: 0 in 0.387s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75599313-bb2b-4e6e-96cf-43ea562ce7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d67443-b14a-418c-82e6-e394854b4d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:37 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Volume volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 (58fe9307-e4d7-4538-bf3a-cc7bc03ca226): created successfully Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d67443-b14a-418c-82e6-e394854b4d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Flow 'volume_create_manager' (c4156c9c-ee4c-478a-977c-0a971bf1d38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7a4433be-c530-4b7b-8b7f-aa7dc9b285d4 tempest-TaggedAttachmentsTest-1400770634 None] Created volume successfully. Sep 01 01:58:47 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:47 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Flow 'volume_create_manager' (2cb40da3-450b-4c08-be67-5e2936febf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c92c14-2690-488c-a24c-4a074a243fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c92c14-2690-488c-a24c-4a074a243fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1508741854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd433ad-df53-4885-8208-dfcc3e0b0f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77e1b402a8e4123998bd96dc8374497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:55Z,use_quota=True,user_id='cd2c0f15499f426a82f8ca253f1849ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2b9edd-ef1a-4291-8440-32f5983ecb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2b9edd-ef1a-4291-8440-32f5983ecb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cca9d46-994b-4db0-840a-6154a7c6b11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cca9d46-994b-4db0-840a-6154a7c6b11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd433ad-df53-4885-8208-dfcc3e0b0f75', 'volume_name': 'volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b134c2d-ed4e-4793-9737-0b47f5fbcc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b134c2d-ed4e-4793-9737-0b47f5fbcc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2479f41e-5d5c-4899-898a-311583d12745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Volume dcd433ad-df53-4885-8208-dfcc3e0b0f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75', 'volume_size': 1} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1508741854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd433ad-df53-4885-8208-dfcc3e0b0f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77e1b402a8e4123998bd96dc8374497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:55Z,use_quota=True,user_id='cd2c0f15499f426a82f8ca253f1849ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Creating volume dcd433ad-df53-4885-8208-dfcc3e0b0f75 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:55 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 01:58:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:55 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 1073741824 Sep 01 01:58:55 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:57 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 1073741824" returned: 0 in 1.480s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:57 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 Sep 01 01:58:57 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:57 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75" returned: 0 in 0.569s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2479f41e-5d5c-4899-898a-311583d12745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4df79e-dddf-4721-a4e9-5dff928b3de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:58 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Volume volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 (dcd433ad-df53-4885-8208-dfcc3e0b0f75): created successfully Sep 01 01:58:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4df79e-dddf-4721-a4e9-5dff928b3de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Flow 'volume_create_manager' (2cb40da3-450b-4c08-be67-5e2936febf84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e2f75292-1f47-4ab9-9783-67f0a6969d83 tempest-DeleteServersTestJSON-434855661 None] Created volume successfully. Sep 01 01:59:04 devstack cinder-volume[87404]: WARNING py.warnings [req-ece8b036-e429-41c0-98c0-57945e589e95 req-bc689c04-7c47-4686-9c86-92eacc54a392 tempest-DeleteServersTestJSON-434855661 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 01 01:59:04 devstack cinder-volume[87404]: .first() Sep 01 01:59:04 devstack cinder-volume[87404]: Sep 01 01:59:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ece8b036-e429-41c0-98c0-57945e589e95 req-bc689c04-7c47-4686-9c86-92eacc54a392 tempest-DeleteServersTestJSON-434855661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ece8b036-e429-41c0-98c0-57945e589e95 req-bc689c04-7c47-4686-9c86-92eacc54a392 tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ece8b036-e429-41c0-98c0-57945e589e95 req-bc689c04-7c47-4686-9c86-92eacc54a392 tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-ece8b036-e429-41c0-98c0-57945e589e95 req-bc689c04-7c47-4686-9c86-92eacc54a392 tempest-DeleteServersTestJSON-434855661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dc47e22-471c-4e73-91f6-6c8d9f5581c9', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:59:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-ece8b036-e429-41c0-98c0-57945e589e95 req-bc689c04-7c47-4686-9c86-92eacc54a392 tempest-DeleteServersTestJSON-434855661 None] attachment_update completed successfully. Sep 01 01:59:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-c3ef56c3-3b1a-4b7c-be79-c502c0870282 req-af3810c5-ca99-45c4-a23d-bcc8354f1f10 tempest-DeleteServersTestJSON-434855661 None] Terminate volume connection completed successfully. Sep 01 01:59:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-c3ef56c3-3b1a-4b7c-be79-c502c0870282 req-af3810c5-ca99-45c4-a23d-bcc8354f1f10 tempest-DeleteServersTestJSON-434855661 None] Deleting attachment 8dc47e22-471c-4e73-91f6-6c8d9f5581c9. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:59:15 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=6,cinder:SELECT=10 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Acquiring lock "cinder-dcd433ad-df53-4885-8208-dfcc3e0b0f75-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Lock "cinder-dcd433ad-df53-4885-8208-dfcc3e0b0f75-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Acquiring lock "cinder-quobyte-dcd433ad-df53-4885-8208-dfcc3e0b0f75" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Lock "cinder-quobyte-dcd433ad-df53-4885-8208-dfcc3e0b0f75" acquired by "delete_volume" :: waited 0.045s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:15 devstack cinder-volume[87404]: INFO oslo.privsep.daemon [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6utxcdue/privsep.sock'] Sep 01 01:59:15 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6utxcdue/privsep.sock Sep 01 01:59:15 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:59:17 devstack cinder-volume[87404]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 01:59:18 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:18 devstack cinder-volume[87404]: INFO oslo.privsep.daemon [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Spawned new privsep daemon via rootwrap Sep 01 01:59:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Accepted privsep connection to /tmp/tmp6utxcdue/privsep.sock {{(pid=87404) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 01:59:18 devstack cinder-volume[87404]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 01:59:18 devstack cinder-volume[87404]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 01:59:18 devstack cinder-volume[87404]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 01:59:18 devstack cinder-volume[87404]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88995 Sep 01 01:59:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88d362d-f20b-4d42-9130-ea9f50dc9d61]: (2,) {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8b268-2672-422e-a529-aaf13f56f4ef]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 Sep 01 01:59:18 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75" returned: 0 in 0.588s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75 Sep 01 01:59:18 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:19 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dcd433ad-df53-4885-8208-dfcc3e0b0f75" returned: 0 in 0.554s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Lock "cinder-quobyte-dcd433ad-df53-4885-8208-dfcc3e0b0f75" released by "delete_volume" :: held 3.548s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:19 devstack cinder-volume[87404]: WARNING cinder.quota [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:59:19 devstack cinder-volume[87404]: WARNING cinder.quota [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Created reservations ['e83d4f6d-1eda-4fa2-8311-6ae0d4eba70f', '676295af-9b8c-4de1-b6c2-5284f60a53d5', 'bad50548-c9b4-4599-b429-14f78eb8e01e', 'd251a2d5-a0a1-4c71-a5ae-8c1220971c6b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:19 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:59:19 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:20 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:20 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:20 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Deleted volume successfully. Sep 01 01:59:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d348991c-766a-4d25-907a-6537f3ec2c3e tempest-DeleteServersTestJSON-434855661 None] Lock "cinder-dcd433ad-df53-4885-8208-dfcc3e0b0f75-delete_volume" released by "delete_volume" :: held 4.766s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Flow 'volume_create_manager' (bdc2ba08-b102-4e60-a937-f52c6bf34c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb8c7dd-7f09-442c-8df4-af8a18c74b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb8c7dd-7f09-442c-8df4-af8a18c74b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-597183075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c804e0c5-8e83-4fc6-814e-0bb3a0374621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e6e41de2a045debecd3f00c217c7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:23Z,use_quota=True,user_id='d089c9a7bd0840b88cc4cb1e5f0934be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecb08b1-9b66-44a6-9eea-8362bfd32864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecb08b1-9b66-44a6-9eea-8362bfd32864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b7c593-4002-4569-90c5-bba45ea06762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b7c593-4002-4569-90c5-bba45ea06762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c804e0c5-8e83-4fc6-814e-0bb3a0374621', 'volume_name': 'volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b099fb0-c21b-45b8-9151-4d8439f875aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b099fb0-c21b-45b8-9151-4d8439f875aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eef9ae-7e0a-4407-bcda-5e129400bf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:23 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Volume c804e0c5-8e83-4fc6-814e-0bb3a0374621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621', 'volume_size': 1} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-597183075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c804e0c5-8e83-4fc6-814e-0bb3a0374621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e6e41de2a045debecd3f00c217c7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:23Z,use_quota=True,user_id='d089c9a7bd0840b88cc4cb1e5f0934be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Creating volume c804e0c5-8e83-4fc6-814e-0bb3a0374621 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:23 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 1073741824 Sep 01 01:59:23 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:23 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 1073741824" returned: 0 in 0.646s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 Sep 01 01:59:23 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:24 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eef9ae-7e0a-4407-bcda-5e129400bf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef7dfdd-8e04-4346-89d0-f41148bcf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Volume volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 (c804e0c5-8e83-4fc6-814e-0bb3a0374621): created successfully Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef7dfdd-8e04-4346-89d0-f41148bcf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Flow 'volume_create_manager' (bdc2ba08-b102-4e60-a937-f52c6bf34c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-516be8d5-70f0-4687-9c7b-b11935d149eb tempest-ServersNegativeTestJSON-1325154986 None] Created volume successfully. Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Flow 'volume_create_manager' (b70c11b8-a3a3-49e6-a3cd-caf903c108da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64a79fc-e41a-44d6-91ad-06ab2de005e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64a79fc-e41a-44d6-91ad-06ab2de005e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-498461232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3399af-6109-4859-8a8b-e8726906bcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e6e41de2a045debecd3f00c217c7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:28Z,use_quota=True,user_id='d089c9a7bd0840b88cc4cb1e5f0934be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9e16b2-a0f9-4f2f-9110-7d5ea331b641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9e16b2-a0f9-4f2f-9110-7d5ea331b641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad1799b-2855-42dc-bc59-1928e7641df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad1799b-2855-42dc-bc59-1928e7641df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3399af-6109-4859-8a8b-e8726906bcc5', 'volume_name': 'volume-1a3399af-6109-4859-8a8b-e8726906bcc5', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec86196-f755-478c-bb30-18aabc62043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec86196-f755-478c-bb30-18aabc62043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc1d6a3-9e3e-4784-95d3-326b1a47aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:28 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Volume 1a3399af-6109-4859-8a8b-e8726906bcc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3399af-6109-4859-8a8b-e8726906bcc5', 'volume_size': 1} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-498461232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3399af-6109-4859-8a8b-e8726906bcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e6e41de2a045debecd3f00c217c7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:28Z,use_quota=True,user_id='d089c9a7bd0840b88cc4cb1e5f0934be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Creating volume 1a3399af-6109-4859-8a8b-e8726906bcc5 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:28 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:28 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 1073741824 Sep 01 01:59:28 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:28 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:59:28 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:28 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 1073741824" returned: 0 in 0.646s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:28 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.372s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 8 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:59:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:28 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 Sep 01 01:59:28 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:29 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5" returned: 0 in 0.324s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc1d6a3-9e3e-4784-95d3-326b1a47aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3399af-6109-4859-8a8b-e8726906bcc5', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921be41c-80e8-4cc2-a399-022d03159673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Volume volume-1a3399af-6109-4859-8a8b-e8726906bcc5 (1a3399af-6109-4859-8a8b-e8726906bcc5): created successfully Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921be41c-80e8-4cc2-a399-022d03159673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Flow 'volume_create_manager' (b70c11b8-a3a3-49e6-a3cd-caf903c108da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-73679c57-7931-4e5b-8c8b-60e88f26c9de tempest-ServersNegativeTestJSON-1325154986 None] Created volume successfully. Sep 01 01:59:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "cinder-1a3399af-6109-4859-8a8b-e8726906bcc5-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-1a3399af-6109-4859-8a8b-e8726906bcc5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "cinder-quobyte-1a3399af-6109-4859-8a8b-e8726906bcc5" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-quobyte-1a3399af-6109-4859-8a8b-e8726906bcc5" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8686d-180c-4bbb-8f9b-6ba6617c6b1c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:33 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 Sep 01 01:59:33 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:33 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5" returned: 0 in 0.534s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:33 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5 Sep 01 01:59:33 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:34 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1a3399af-6109-4859-8a8b-e8726906bcc5" returned: 0 in 0.523s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-quobyte-1a3399af-6109-4859-8a8b-e8726906bcc5" released by "delete_volume" :: held 1.143s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Created reservations ['0bc7a8c5-8101-481c-878b-b75b11c06197', '5f2fdc24-e202-4fdc-8e46-2c2ab175ed46', 'c964eb5d-6570-44c2-925f-5f9a0c323f13', 'fcb2dd90-90ff-4a58-b38c-94c35ac53ed5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:34 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:59:34 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:34 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.369s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Deleted volume successfully. Sep 01 01:59:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6deff62-25d7-4f85-ba72-06c918d8669f tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-1a3399af-6109-4859-8a8b-e8726906bcc5-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "cinder-c804e0c5-8e83-4fc6-814e-0bb3a0374621-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-c804e0c5-8e83-4fc6-814e-0bb3a0374621-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "cinder-quobyte-c804e0c5-8e83-4fc6-814e-0bb3a0374621" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-quobyte-c804e0c5-8e83-4fc6-814e-0bb3a0374621" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2c1d19-596d-435e-b484-b050987bc5fb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 Sep 01 01:59:35 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621" returned: 0 in 0.473s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:36 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621 Sep 01 01:59:36 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c804e0c5-8e83-4fc6-814e-0bb3a0374621" returned: 0 in 0.359s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-quobyte-c804e0c5-8e83-4fc6-814e-0bb3a0374621" released by "delete_volume" :: held 0.873s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Created reservations ['817a70d1-66e9-462b-a94c-92bd8f075f14', 'aef0cea0-a2c7-4dcc-b10e-8fddb664fe86', 'd1e06264-8112-425a-8234-c421e84cd90c', '47247441-f09b-46f0-96d6-71e863338519'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:36 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 01:59:36 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:37 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.462s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:37 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Deleted volume successfully. Sep 01 01:59:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-bfb678b7-aff4-4454-84b3-ff7d9219252d tempest-ServersNegativeTestJSON-1325154986 None] Lock "cinder-c804e0c5-8e83-4fc6-814e-0bb3a0374621-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:49 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=29,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:49 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=33,cinder:SELECT=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-9e43e7a3-30e1-40f9-b740-279c21edb753 req-d05573d0-9c4e-4fe4-95c4-2d48524b7172 tempest-TaggedAttachmentsTest-1400770634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-9e43e7a3-30e1-40f9-b740-279c21edb753 req-d05573d0-9c4e-4fe4-95c4-2d48524b7172 tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-9e43e7a3-30e1-40f9-b740-279c21edb753 req-d05573d0-9c4e-4fe4-95c4-2d48524b7172 tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-9e43e7a3-30e1-40f9-b740-279c21edb753 req-d05573d0-9c4e-4fe4-95c4-2d48524b7172 tempest-TaggedAttachmentsTest-1400770634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31e22ffd-5bb4-45ab-bd92-00bafe409f56', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:59:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-9e43e7a3-30e1-40f9-b740-279c21edb753 req-d05573d0-9c4e-4fe4-95c4-2d48524b7172 tempest-TaggedAttachmentsTest-1400770634 None] attachment_update completed successfully. Sep 01 02:00:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c1307ac0-4d2d-41e2-8dc7-180ac685595a tempest-GroupsV314Test-2071041877 None] Group tempest-GroupsV314Test-Group-2081537375: creating Sep 01 02:00:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c1307ac0-4d2d-41e2-8dc7-180ac685595a tempest-GroupsV314Test-2071041877 None] Group tempest-GroupsV314Test-Group-2081537375: created successfully Sep 01 02:00:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c1307ac0-4d2d-41e2-8dc7-180ac685595a tempest-GroupsV314Test-2071041877 None] Create group completed successfully. Sep 01 02:00:01 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Flow 'volume_create_manager' (e41ba317-1672-41ed-9499-31034e1059f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cf519a-d334-4518-8da8-1344a44d9355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cf519a-d334-4518-8da8-1344a44d9355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551998869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=454aacc4-2d33-450f-a52a-bf3992b3e67e,host='devstack@QuobyteHD#QuobyteHD',id=2467dbe0-f347-40fa-8ac9-8197f9f28430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17badc728f3f475e94194d541b44a926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:02Z,use_quota=True,user_id='d4d2cd6b3dbd4b5faa5ae6068b5346c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e19962d2-85b6-47cd-b099-d77972923f4f),volume_type_id=e19962d2-85b6-47cd-b099-d77972923f4f)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6084953e-77ec-41aa-bab2-3ac237a16b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6084953e-77ec-41aa-bab2-3ac237a16b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d634f385-ff08-4b69-8552-815793b5a0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d634f385-ff08-4b69-8552-815793b5a0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2467dbe0-f347-40fa-8ac9-8197f9f28430', 'volume_name': 'volume-2467dbe0-f347-40fa-8ac9-8197f9f28430', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c233a149-f11e-4303-ac34-096637e84773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c233a149-f11e-4303-ac34-096637e84773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0810d312-c637-4cf2-b336-3b9edb09d7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:02 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Volume 2467dbe0-f347-40fa-8ac9-8197f9f28430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2467dbe0-f347-40fa-8ac9-8197f9f28430', 'volume_size': 1} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=454aacc4-2d33-450f-a52a-bf3992b3e67e,created_at=2026-09-01T00:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551998869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=454aacc4-2d33-450f-a52a-bf3992b3e67e,host='devstack@QuobyteHD#QuobyteHD',id=2467dbe0-f347-40fa-8ac9-8197f9f28430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17badc728f3f475e94194d541b44a926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:02Z,use_quota=True,user_id='d4d2cd6b3dbd4b5faa5ae6068b5346c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e19962d2-85b6-47cd-b099-d77972923f4f),volume_type_id=e19962d2-85b6-47cd-b099-d77972923f4f)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Creating volume 2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:02 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:00:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:02 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 1073741824 Sep 01 02:00:02 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:03 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 1073741824" returned: 0 in 1.105s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-a11edc92-9e4f-482e-a111-aa18cbad132a req-cbe1dd09-9d7c-452c-81e3-d5da160b8b2f tempest-TaggedAttachmentsTest-1400770634 None] Terminate volume connection completed successfully. Sep 01 02:00:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-a11edc92-9e4f-482e-a111-aa18cbad132a req-cbe1dd09-9d7c-452c-81e3-d5da160b8b2f tempest-TaggedAttachmentsTest-1400770634 None] Deleting attachment 31e22ffd-5bb4-45ab-bd92-00bafe409f56. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:00:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:03 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 Sep 01 02:00:03 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:03 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430" returned: 0 in 0.501s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0810d312-c637-4cf2-b336-3b9edb09d7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2467dbe0-f347-40fa-8ac9-8197f9f28430', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebbb562-7917-4ee5-a3a5-78fe2b6d87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Volume volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 (2467dbe0-f347-40fa-8ac9-8197f9f28430): created successfully Sep 01 02:00:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebbb562-7917-4ee5-a3a5-78fe2b6d87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Flow 'volume_create_manager' (e41ba317-1672-41ed-9499-31034e1059f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cafc5bbe-fafe-4616-9d15-094a201f1928 tempest-GroupsV314Test-2071041877 None] Created volume successfully. Sep 01 02:00:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:06 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Cloning volume 2467dbe0-f347-40fa-8ac9-8197f9f28430 to volume e6d3081a-873c-4c4e-8a99-a311eeabb652 Sep 01 02:00:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Creating offline snapshot bf486ae7-dcbf-429e-bec3-cee9c227ddcf of volume 2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:00:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbef503-e903-44e8-a9ba-6aafdcb71527]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:07 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 Sep 01 02:00:07 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:07 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430" returned: 0 in 0.860s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:07 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf 1G Sep 01 02:00:07 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:08 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf 1G" returned: 0 in 0.587s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:08 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf Sep 01 02:00:08 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:08 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf" returned: 0 in 0.569s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:08 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:09 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf Sep 01 02:00:09 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:09 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf" returned: 0 in 0.322s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:09 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info Sep 01 02:00:09 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:09 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info" returned: 0 in 0.423s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:09 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:09 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info Sep 01 02:00:09 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:10 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.info" returned: 0 in 0.339s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Acquiring lock "cinder-quobyte-e6d3081a-873c-4c4e-8a99-a311eeabb652" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-e6d3081a-873c-4c4e-8a99-a311eeabb652" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] snapshot: bf486ae7-dcbf-429e-bec3-cee9c227ddcf, volume: e6d3081a-873c-4c4e-8a99-a311eeabb652, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[359d9f64-bee0-4fb1-bdb4-575701a45571]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:10 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf Sep 01 02:00:10 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:10 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf" returned: 0 in 0.730s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2467dbe0-f347-40fa-8ac9-8197f9f28430(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[628c584c-c840-4aa9-96ab-749fafcb6efb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:11 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 Sep 01 02:00:11 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:11 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430" returned: 0 in 0.494s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:00:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:11 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 Sep 01 02:00:11 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:19 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:19 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:20 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652" returned: 0 in 8.695s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:00:20 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Converted 1024.00 MB image at 117.75 MB/s Sep 01 02:00:20 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:20 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 Sep 01 02:00:20 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:20 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652" returned: 0 in 0.315s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-e6d3081a-873c-4c4e-8a99-a311eeabb652" released by "_copy_volume_from_snapshot" :: held 10.349s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Acquiring lock "cinder-quobyte-bf486ae7-dcbf-429e-bec3-cee9c227ddcf" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-bf486ae7-dcbf-429e-bec3-cee9c227ddcf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Deleting offline snapshot bf486ae7-dcbf-429e-bec3-cee9c227ddcf of volume 2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] snapshot_file for this snap is: volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef71371-5f8c-467f-8e22-da3c48b6668d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:20 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf Sep 01 02:00:20 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:21 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf" returned: 0 in 0.456s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2467dbe0-f347-40fa-8ac9-8197f9f28430(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:00:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[154344e7-2372-4ab5-bc72-84f46b367e1e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:21 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 Sep 01 02:00:21 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:21 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430" returned: 0 in 0.756s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:21 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf Sep 01 02:00:21 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:22 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf" returned: 0 in 0.451s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:22 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf Sep 01 02:00:22 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:22 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430.bf486ae7-dcbf-429e-bec3-cee9c227ddcf" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-bf486ae7-dcbf-429e-bec3-cee9c227ddcf" released by "_delete_snapshot" :: held 2.258s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.057s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ef34f61c-729b-49b0-b47f-4727c3d8db42 tempest-GroupsV314Test-2071041877 None] Create group from source-group-454aacc4-2d33-450f-a52a-bf3992b3e67e completed successfully. Sep 01 02:00:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Acquiring lock "cinder-quobyte-e6d3081a-873c-4c4e-8a99-a311eeabb652" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-e6d3081a-873c-4c4e-8a99-a311eeabb652" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:24 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c06c919-83b8-44b3-9ef2-b3f2d1c5769e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:24 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 Sep 01 02:00:24 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:25 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652" returned: 0 in 0.743s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:25 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652 Sep 01 02:00:25 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:25 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e6d3081a-873c-4c4e-8a99-a311eeabb652" returned: 0 in 0.421s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-e6d3081a-873c-4c4e-8a99-a311eeabb652" released by "delete_volume" :: held 1.242s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Created reservations ['5c460150-1800-45c9-a360-84be898f9fd1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:26 devstack cinder-volume[87404]: WARNING cinder.quota [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-716249801 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-716249801, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:26 devstack cinder-volume[87404]: WARNING cinder.quota [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-716249801 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-716249801, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Created reservations ['9c4c686a-0572-442e-b316-100c47d870a7', '3b76db4e-8a9a-407d-86c7-a96d56b5a3bd', '2617477e-d1d1-43f8-98fb-d28a8bdd4e36', 'a3b8e7b4-315c-4bb3-850f-0a0da2cd65c5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:26 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:00:26 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:26 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:26 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2ad0e24d-62c9-4b7a-8bac-6e222648589a tempest-GroupsV314Test-2071041877 None] Delete group completed successfully. Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Acquiring lock "cinder-quobyte-2467dbe0-f347-40fa-8ac9-8197f9f28430" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-2467dbe0-f347-40fa-8ac9-8197f9f28430" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e616824c-2eeb-434b-9125-6fd5908549a8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Acquiring lock "cinder-58fe9307-e4d7-4538-bf3a-cc7bc03ca226-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Lock "cinder-58fe9307-e4d7-4538-bf3a-cc7bc03ca226-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Acquiring lock "cinder-quobyte-58fe9307-e4d7-4538-bf3a-cc7bc03ca226" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Lock "cinder-quobyte-58fe9307-e4d7-4538-bf3a-cc7bc03ca226" acquired by "delete_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:27 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 Sep 01 02:00:27 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d4f14-f729-475a-be81-6e58c006407d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 Sep 01 02:00:28 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430" returned: 0 in 0.780s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:28 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:00:28 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430 Sep 01 02:00:28 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:28 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226" returned: 0 in 0.978s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:29 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226 Sep 01 02:00:29 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:29 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.686s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:29 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2467dbe0-f347-40fa-8ac9-8197f9f28430" returned: 0 in 0.824s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Lock "cinder-quobyte-2467dbe0-f347-40fa-8ac9-8197f9f28430" released by "delete_volume" :: held 1.715s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Created reservations ['b65d4007-8a76-433f-aa0c-c698ec86dd21'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Created reservations ['1f350d73-2c24-43c5-b423-3886a94cb9be', '2ffd8bf6-ed30-470b-b70c-a15b794a8deb', 'ce13110a-de10-4101-9117-b36e2750f3f1', '0e538f82-adff-435d-a2a5-621e863fb24c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:29 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58fe9307-e4d7-4538-bf3a-cc7bc03ca226" returned: 0 in 0.856s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Lock "cinder-quobyte-58fe9307-e4d7-4538-bf3a-cc7bc03ca226" released by "delete_volume" :: held 1.927s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Created reservations ['5e19d8ae-518b-4c65-8eef-c40436817b75', 'd27c4053-db59-418c-ac63-bc7e3afd641f', '0d5ba941-2168-4a30-9d35-1478afe22d23', '0b9698a5-5468-41ee-bc9e-1fa5b86150b0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:30 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:00:30 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:30 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:00:30 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:30 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.431s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-78c8b73c-9741-4d30-8fca-4d3650763f8c tempest-GroupsV314Test-2071041877 None] Delete group completed successfully. Sep 01 02:00:30 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Flow 'volume_create_manager' (b437f177-cd29-4ad4-b1fb-d1b70f344f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a713e9bf-b4c7-4805-ba97-2372f9e59172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a713e9bf-b4c7-4805-ba97-2372f9e59172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-557650830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbf2ae9-e9b7-4463-811d-cdcedc4e3185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0607334b4e5548c3b7433dde38b659a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:31Z,use_quota=True,user_id='0cccc4f2b35144e1a2a7adc043b3fb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0861e14b-a9f3-4195-b94e-576e07feb555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0861e14b-a9f3-4195-b94e-576e07feb555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7b95b8-9a2f-4cc2-8405-9aff97d2141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7b95b8-9a2f-4cc2-8405-9aff97d2141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbf2ae9-e9b7-4463-811d-cdcedc4e3185', 'volume_name': 'volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6526714d-1f9c-415e-8c5b-2749cdc58c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6526714d-1f9c-415e-8c5b-2749cdc58c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8299b734-35c5-469a-8515-117d6310511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:31 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Volume dbbf2ae9-e9b7-4463-811d-cdcedc4e3185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185', 'volume_size': 1} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-557650830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbf2ae9-e9b7-4463-811d-cdcedc4e3185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0607334b4e5548c3b7433dde38b659a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:31Z,use_quota=True,user_id='0cccc4f2b35144e1a2a7adc043b3fb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Creating volume dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:31 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:00:31 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.999s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Deleted volume successfully. Sep 01 02:00:31 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 1073741824 Sep 01 02:00:31 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a136aee2-af69-4bf8-a580-9baa7226e6bb tempest-TaggedAttachmentsTest-1400770634 None] Lock "cinder-58fe9307-e4d7-4538-bf3a-cc7bc03ca226-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:32 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 1073741824" returned: 0 in 1.090s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:32 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 Sep 01 02:00:32 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:33 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185" returned: 0 in 0.496s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8299b734-35c5-469a-8515-117d6310511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bc96b1-ba6f-4956-a6e2-a6efdea12fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Volume volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 (dbbf2ae9-e9b7-4463-811d-cdcedc4e3185): created successfully Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bc96b1-ba6f-4956-a6e2-a6efdea12fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Flow 'volume_create_manager' (b437f177-cd29-4ad4-b1fb-d1b70f344f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f8a58e65-bf6c-4c43-8be3-657cc52b0b2b tempest-ServerActionsTestOtherA-91937418 None] Created volume successfully. Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Flow 'volume_create_manager' (16d1438e-cc2e-4108-b8ba-690c93d692be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0539a671-3c7b-4aee-983c-0a6671d7790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0539a671-3c7b-4aee-983c-0a6671d7790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1818595306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3f7663-7ae8-4087-8036-77abc9494901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649219866d1044d4930992df94b7485b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:38Z,use_quota=True,user_id='5e2a4c49598c4607a6db78288330d722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f78821-4c62-420c-b932-924e4a01c2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f78821-4c62-420c-b932-924e4a01c2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68122e6a-cabe-4f7e-9508-2390f6165084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68122e6a-cabe-4f7e-9508-2390f6165084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3f7663-7ae8-4087-8036-77abc9494901', 'volume_name': 'volume-3d3f7663-7ae8-4087-8036-77abc9494901', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4a5a29-6761-4c99-a325-9a3d14f059b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4a5a29-6761-4c99-a325-9a3d14f059b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28afe73-8ede-4e27-a38b-219afb5063a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:37 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Volume 3d3f7663-7ae8-4087-8036-77abc9494901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3f7663-7ae8-4087-8036-77abc9494901', 'volume_size': 1} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1818595306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3f7663-7ae8-4087-8036-77abc9494901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649219866d1044d4930992df94b7485b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:38Z,use_quota=True,user_id='5e2a4c49598c4607a6db78288330d722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Creating volume 3d3f7663-7ae8-4087-8036-77abc9494901 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:37 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:00:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:37 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 1073741824 Sep 01 02:00:37 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:38 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 1073741824" returned: 0 in 0.927s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:38 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 Sep 01 02:00:38 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:39 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901" returned: 0 in 0.683s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28afe73-8ede-4e27-a38b-219afb5063a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3f7663-7ae8-4087-8036-77abc9494901', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92c62f2-7298-440b-bdbe-39879388c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:39 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Volume volume-3d3f7663-7ae8-4087-8036-77abc9494901 (3d3f7663-7ae8-4087-8036-77abc9494901): created successfully Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92c62f2-7298-440b-bdbe-39879388c494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Flow 'volume_create_manager' (16d1438e-cc2e-4108-b8ba-690c93d692be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7b990196-6585-4f39-ac9c-4aeb33719d0c tempest-VolumesAdminNegativeTest-576212992 None] Created volume successfully. Sep 01 02:00:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Acquiring lock "cinder-3d3f7663-7ae8-4087-8036-77abc9494901-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Lock "cinder-3d3f7663-7ae8-4087-8036-77abc9494901-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Acquiring lock "cinder-quobyte-3d3f7663-7ae8-4087-8036-77abc9494901" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Lock "cinder-quobyte-3d3f7663-7ae8-4087-8036-77abc9494901" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:42 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab689ec-77fb-4207-a172-210fa69cdeaa]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:42 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 Sep 01 02:00:42 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:43 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901" returned: 0 in 0.726s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:43 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901 Sep 01 02:00:43 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:43 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3d3f7663-7ae8-4087-8036-77abc9494901" returned: 0 in 0.863s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Lock "cinder-quobyte-3d3f7663-7ae8-4087-8036-77abc9494901" released by "delete_volume" :: held 1.687s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Created reservations ['aa3a2bf1-be36-4e73-8fb1-6778e68af9bd', '7e34dbd8-267a-467b-be99-0959208a43b3', 'e823e171-82a4-4dd8-9bb1-0063fad097d3', 'f32c74fd-ddfe-4d4c-80cc-3e9f211b57e2'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:44 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:00:44 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:44 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.457s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Deleted volume successfully. Sep 01 02:00:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df46f548-d966-4fda-b4f7-f10717883eac tempest-VolumesAdminNegativeTest-576212992 None] Lock "cinder-3d3f7663-7ae8-4087-8036-77abc9494901-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:54 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=46,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:54 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=47,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:58 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Flow 'volume_create_manager' (3dbc4135-31a5-4f51-bb6a-fc890e5b5a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03365af-69e2-4060-b497-72abf120d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03365af-69e2-4060-b497-72abf120d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-383947957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a75c14a-608f-4c13-8e75-ecc03bf917dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63afa8dc71d24911a7ae90241a4f7f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:59Z,use_quota=True,user_id='14462f5a3973431e9548a46b298842a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(130cbf95-734f-4817-b0ac-79fde34572a4),volume_type_id=130cbf95-734f-4817-b0ac-79fde34572a4)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cfe8a7-4b53-4f7c-bb79-0bd0994ff6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cfe8a7-4b53-4f7c-bb79-0bd0994ff6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9096d3d6-2d50-41eb-889a-3721d87b37f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9096d3d6-2d50-41eb-889a-3721d87b37f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a75c14a-608f-4c13-8e75-ecc03bf917dd', 'volume_name': 'volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30282456-ee36-409d-9d93-22a4b21976cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30282456-ee36-409d-9d93-22a4b21976cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c37a981-ab69-4d6a-ade0-dc2e53b676aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:59 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Volume 7a75c14a-608f-4c13-8e75-ecc03bf917dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd', 'volume_size': 1} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-383947957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a75c14a-608f-4c13-8e75-ecc03bf917dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63afa8dc71d24911a7ae90241a4f7f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:59Z,use_quota=True,user_id='14462f5a3973431e9548a46b298842a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(130cbf95-734f-4817-b0ac-79fde34572a4),volume_type_id=130cbf95-734f-4817-b0ac-79fde34572a4)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Creating volume 7a75c14a-608f-4c13-8e75-ecc03bf917dd {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:59 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:59 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd 1073741824 Sep 01 02:00:59 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:59 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd 1073741824" returned: 0 in 0.740s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:59 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd Sep 01 02:00:59 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:00 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd" returned: 0 in 0.361s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c37a981-ab69-4d6a-ade0-dc2e53b676aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0241e0b-bcaa-4f28-91b5-fbcdb4bfdda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Volume volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd (7a75c14a-608f-4c13-8e75-ecc03bf917dd): created successfully Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0241e0b-bcaa-4f28-91b5-fbcdb4bfdda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Flow 'volume_create_manager' (3dbc4135-31a5-4f51-bb6a-fc890e5b5a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8d6f18b9-51e9-4358-bfd4-71b7c5142c2d tempest-VolumeTypesAccessTest-1821656303 None] Created volume successfully. Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Acquiring lock "cinder-7a75c14a-608f-4c13-8e75-ecc03bf917dd-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Lock "cinder-7a75c14a-608f-4c13-8e75-ecc03bf917dd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Acquiring lock "cinder-quobyte-7a75c14a-608f-4c13-8e75-ecc03bf917dd" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Lock "cinder-quobyte-7a75c14a-608f-4c13-8e75-ecc03bf917dd" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7715f5-3678-4a62-a398-81b184887f11]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:01 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd Sep 01 02:01:01 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:01 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd" returned: 0 in 0.507s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:01 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd Sep 01 02:01:01 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:02 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7a75c14a-608f-4c13-8e75-ecc03bf917dd" returned: 0 in 0.391s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Lock "cinder-quobyte-7a75c14a-608f-4c13-8e75-ecc03bf917dd" released by "delete_volume" :: held 0.960s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:02 devstack cinder-volume[87404]: WARNING cinder.quota [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1651890140 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1651890140, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:02 devstack cinder-volume[87404]: WARNING cinder.quota [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1651890140 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1651890140, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Created reservations ['4fbd35a9-8857-4b4d-a439-dfaa63eef4af', '5f9777fc-70cc-430f-a3bc-658e6ffa2273', 'b0ddacd3-790e-4825-9531-dc0834adfe47', '03304745-6462-4df0-b649-9ce720f479fe'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:02 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:01:02 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:02 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.389s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Deleted volume successfully. Sep 01 02:01:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d25dcd57-297e-4ac1-8255-263e1986610f tempest-VolumeTypesAccessTest-1821656303 None] Lock "cinder-7a75c14a-608f-4c13-8e75-ecc03bf917dd-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=4 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=13,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-9090aaf9-0b04-4fa7-aacb-bc5ef1caeab3 req-d8ddc877-a3c9-4f08-b77c-6d59532c33e7 tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-9090aaf9-0b04-4fa7-aacb-bc5ef1caeab3 req-d8ddc877-a3c9-4f08-b77c-6d59532c33e7 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-9090aaf9-0b04-4fa7-aacb-bc5ef1caeab3 req-d8ddc877-a3c9-4f08-b77c-6d59532c33e7 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-9090aaf9-0b04-4fa7-aacb-bc5ef1caeab3 req-d8ddc877-a3c9-4f08-b77c-6d59532c33e7 tempest-ServerActionsTestOtherA-91937418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b656ee54-8e9f-4b4d-aa45-d7d8354a2acf', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:01:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-9090aaf9-0b04-4fa7-aacb-bc5ef1caeab3 req-d8ddc877-a3c9-4f08-b77c-6d59532c33e7 tempest-ServerActionsTestOtherA-91937418 None] attachment_update completed successfully. Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Flow 'volume_create_manager' (904db26c-9943-4401-8d8a-f64cf74ab0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68340d8c-9025-4497-a462-cd92df6a085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68340d8c-9025-4497-a462-cd92df6a085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-814189936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b612b5ad-7e2c-4932-af84-b2f278aa68c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11009d058fd4187929dd4fbd1dab308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:21Z,use_quota=True,user_id='debd6132ae154d13bde2f2fb7ddcb649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54670c5c-0db0-4cf4-a6f3-c268031103c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54670c5c-0db0-4cf4-a6f3-c268031103c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640829b0-b44d-4831-bb15-a69c4afbefff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:20 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:01:22 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640829b0-b44d-4831-bb15-a69c4afbefff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b612b5ad-7e2c-4932-af84-b2f278aa68c8', 'volume_name': 'volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:22 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db930ab5-eb7c-42ff-9a2d-1c31e08f8607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:22 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db930ab5-eb7c-42ff-9a2d-1c31e08f8607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:22 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d1750f-8725-4bbe-b885-61273ccdf90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:22 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Volume b612b5ad-7e2c-4932-af84-b2f278aa68c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:01:22 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Trying to clone b612b5ad-7e2c-4932-af84-b2f278aa68c8 from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:01:22 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:01:22 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e390f4-8b4f-4751-b157-6199072e204b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:23 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD Sep 01 02:01:23 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:23 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 is fetched for user debd6132ae154d13bde2f2fb7ddcb649. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:01:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-e9dbe33b-5f50-4c4e-9f18-5930c7348e11 tempest-ServerActionsTestOtherA-91937418 None] Terminate volume connection completed successfully. Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-e9dbe33b-5f50-4c4e-9f18-5930c7348e11 tempest-ServerActionsTestOtherA-91937418 None] Deleting attachment b656ee54-8e9f-4b4d-aa45-d7d8354a2acf. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58eb131-ace9-4d89-9179-df3a93b2463f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:23 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD Sep 01 02:01:23 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:24 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-814189936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b612b5ad-7e2c-4932-af84-b2f278aa68c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11009d058fd4187929dd4fbd1dab308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:21Z,use_quota=True,user_id='debd6132ae154d13bde2f2fb7ddcb649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Creating volume b612b5ad-7e2c-4932-af84-b2f278aa68c8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:24 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:01:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:24 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 1073741824 Sep 01 02:01:24 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-9ead5c43-e9c2-4d4e-b0fc-bd4682c3a495 tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 1073741824" returned: 0 in 1.114s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:25 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:25 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 Sep 01 02:01:25 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:26 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8" returned: 0 in 0.537s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-9ead5c43-e9c2-4d4e-b0fc-bd4682c3a495 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.761s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-9ead5c43-e9c2-4d4e-b0fc-bd4682c3a495 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Attempting download of d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume b612b5ad-7e2c-4932-af84-b2f278aa68c8. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-9ead5c43-e9c2-4d4e-b0fc-bd4682c3a495 tempest-ServerActionsTestOtherA-91937418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c24684fb-8404-4552-aab6-1f4a2e3fc6d6', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db849d-e63d-43f2-b311-be2006bfd30f]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-8c859e09-7730-45b4-a508-e6394c4e5041 req-9ead5c43-e9c2-4d4e-b0fc-bd4682c3a495 tempest-ServerActionsTestOtherA-91937418 None] attachment_update completed successfully. Sep 01 02:01:26 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q Sep 01 02:01:26 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:27 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q" returned: 0 in 0.607s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:27 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q Sep 01 02:01:27 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:27 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q" returned: 1 in 0.695s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_nyyd5b3q' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:01:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915ecea-a009-4059-8ea6-3d5f06ed8327]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:28 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD Sep 01 02:01:28 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:28 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 was qcow2, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:01:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:28 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:01:28 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:28 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 Sep 01 02:01:28 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:29 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.694s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:01:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:01:32 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8" returned: 0 in 4.040s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:32 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_qs6em7tzdevstack@QuobyteHD, size 112.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:01:32 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Converted 112.00 MB image at 27.68 MB/s Sep 01 02:01:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:32 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 1G Sep 01 02:01:32 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:33 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 1G" returned: 0 in 0.771s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Downloaded image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume b612b5ad-7e2c-4932-af84-b2f278aa68c8 successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 for user debd6132ae154d13bde2f2fb7ddcb649 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Marking volume b612b5ad-7e2c-4932-af84-b2f278aa68c8 as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Copying metadata from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 to b612b5ad-7e2c-4932-af84-b2f278aa68c8. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Creating volume glance metadata for volume b612b5ad-7e2c-4932-af84-b2f278aa68c8 backed by image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d1750f-8725-4bbe-b885-61273ccdf90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677d3acc-4329-4347-b39a-196f51d92571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Volume volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 (b612b5ad-7e2c-4932-af84-b2f278aa68c8): created successfully Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677d3acc-4329-4347-b39a-196f51d92571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Flow 'volume_create_manager' (904db26c-9943-4401-8d8a-f64cf74ab0f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-11f5e020-f26c-4401-93a2-4cae45d39a90 tempest-VolumesImageMetadata-127347153 None] Created volume successfully. Sep 01 02:01:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Acquiring lock "cinder-b612b5ad-7e2c-4932-af84-b2f278aa68c8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Lock "cinder-b612b5ad-7e2c-4932-af84-b2f278aa68c8-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Acquiring lock "cinder-quobyte-b612b5ad-7e2c-4932-af84-b2f278aa68c8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Lock "cinder-quobyte-b612b5ad-7e2c-4932-af84-b2f278aa68c8" acquired by "delete_volume" :: waited 0.033s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd3778-f0ff-470b-96a1-52232800a4b4]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:36 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 Sep 01 02:01:36 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:36 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8" returned: 0 in 0.681s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:36 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8 Sep 01 02:01:36 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:37 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b612b5ad-7e2c-4932-af84-b2f278aa68c8" returned: 0 in 0.576s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Lock "cinder-quobyte-b612b5ad-7e2c-4932-af84-b2f278aa68c8" released by "delete_volume" :: held 1.331s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Created reservations ['c3714b6b-1f1b-4671-b629-1919ee77d192', 'c4eedfac-c89c-4782-94e0-be5b35890348', '4d99dd4c-a870-4f3b-b457-d18f161c0160', '3e42e83d-f033-4add-8a36-966fb7606305'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:37 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:01:37 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:37 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.311s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Deleted volume successfully. Sep 01 02:01:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-99e5aaa1-70b5-4be7-8162-03ff19aee6dd tempest-VolumesImageMetadata-127347153 None] Lock "cinder-b612b5ad-7e2c-4932-af84-b2f278aa68c8-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:47 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=33,cinder:UPDATE=14,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Flow 'volume_create_manager' (baef8426-4d57-4834-93ac-007666ca7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816b1c66-9e18-4007-8385-d00bf8c70188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816b1c66-9e18-4007-8385-d00bf8c70188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1331631222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e147266e-de14-4262-b29b-56356bfd36ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f16eaac79c4f4e9bb0674f74e4dc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:48Z,use_quota=True,user_id='bf15ee00fdc7403ba739cc3e0c3e9777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc2e2b0-b5b3-4ecb-956b-d060d215d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc2e2b0-b5b3-4ecb-956b-d060d215d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db48543-4c49-4b6b-93d3-bd83176c48f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db48543-4c49-4b6b-93d3-bd83176c48f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e147266e-de14-4262-b29b-56356bfd36ed', 'volume_name': 'volume-e147266e-de14-4262-b29b-56356bfd36ed', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe70aa2-eeb7-47ac-97f7-81b4b7ee21a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe70aa2-eeb7-47ac-97f7-81b4b7ee21a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350dcad1-2463-40e3-bae4-b4ac8cc9401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Volume e147266e-de14-4262-b29b-56356bfd36ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e147266e-de14-4262-b29b-56356bfd36ed', 'volume_size': 1} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1331631222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e147266e-de14-4262-b29b-56356bfd36ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f16eaac79c4f4e9bb0674f74e4dc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:48Z,use_quota=True,user_id='bf15ee00fdc7403ba739cc3e0c3e9777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Creating volume e147266e-de14-4262-b29b-56356bfd36ed {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:48 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:01:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:48 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed 1073741824 Sep 01 02:01:48 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:49 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed 1073741824" returned: 0 in 0.638s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:49 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed Sep 01 02:01:49 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:49 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed" returned: 0 in 0.368s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350dcad1-2463-40e3-bae4-b4ac8cc9401d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e147266e-de14-4262-b29b-56356bfd36ed', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c42df7-86f1-4b9e-8758-64125d21211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Volume volume-e147266e-de14-4262-b29b-56356bfd36ed (e147266e-de14-4262-b29b-56356bfd36ed): created successfully Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c42df7-86f1-4b9e-8758-64125d21211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Flow 'volume_create_manager' (baef8426-4d57-4834-93ac-007666ca7bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f361bfa3-853a-4777-bf6b-32887a6733e6 tempest-AbsoluteLimitsTests-1443523954 None] Created volume successfully. Sep 01 02:01:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Acquiring lock "cinder-e147266e-de14-4262-b29b-56356bfd36ed-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Lock "cinder-e147266e-de14-4262-b29b-56356bfd36ed-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Acquiring lock "cinder-quobyte-e147266e-de14-4262-b29b-56356bfd36ed" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Lock "cinder-quobyte-e147266e-de14-4262-b29b-56356bfd36ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fd6ac-edc6-4ff0-821f-23b74f916018]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:51 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed Sep 01 02:01:51 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed" returned: 0 in 0.547s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:51 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed Sep 01 02:01:51 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:51 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e147266e-de14-4262-b29b-56356bfd36ed" returned: 0 in 0.419s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Lock "cinder-quobyte-e147266e-de14-4262-b29b-56356bfd36ed" released by "delete_volume" :: held 1.037s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:51 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Created reservations ['f05580da-0079-45ac-9503-470f17c9a7ca', 'ad438e80-81cc-4d36-be54-d7875d8e83be', 'f0037739-e6a8-46ed-a3c7-e1a3cecaa08f', '2c0613ac-2529-4c95-9322-3e08a3fe1e23'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:52 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:01:52 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:52 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.474s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Deleted volume successfully. Sep 01 02:01:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96469aa1-0e7b-4dd4-b231-9ebca0a5be7b tempest-AbsoluteLimitsTests-1443523954 None] Lock "cinder-e147266e-de14-4262-b29b-56356bfd36ed-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Flow 'volume_create_manager' (b158de0a-a4d4-47dd-baaf-355d8d7e6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4514ea8-a889-48dc-b5ec-40dcd7caf724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4514ea8-a889-48dc-b5ec-40dcd7caf724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770839055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73feeff7-7c44-4918-b54c-a30ca8ce0119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cde8a8e25c4a1ea0c0d91e2725675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:53Z,use_quota=True,user_id='e20527e6fa7f4ae0aaca0631af09a1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac3070-8c48-4221-b046-83dbc56c1f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac3070-8c48-4221-b046-83dbc56c1f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744031f9-3048-454f-9520-d146b89f83a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744031f9-3048-454f-9520-d146b89f83a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73feeff7-7c44-4918-b54c-a30ca8ce0119', 'volume_name': 'volume-73feeff7-7c44-4918-b54c-a30ca8ce0119', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6f7a67-694e-4e57-8c5e-98c746ad2b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6f7a67-694e-4e57-8c5e-98c746ad2b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05431a9-732c-49aa-b176-588571135d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:53 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Volume 73feeff7-7c44-4918-b54c-a30ca8ce0119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73feeff7-7c44-4918-b54c-a30ca8ce0119', 'volume_size': 1} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770839055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73feeff7-7c44-4918-b54c-a30ca8ce0119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cde8a8e25c4a1ea0c0d91e2725675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:53Z,use_quota=True,user_id='e20527e6fa7f4ae0aaca0631af09a1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Creating volume 73feeff7-7c44-4918-b54c-a30ca8ce0119 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:53 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:01:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:53 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 1073741824 Sep 01 02:01:53 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:54 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 1073741824" returned: 0 in 0.777s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:54 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 Sep 01 02:01:54 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:54 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05431a9-732c-49aa-b176-588571135d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73feeff7-7c44-4918-b54c-a30ca8ce0119', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fe11cb-0577-49bd-a704-7344aaf90170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Volume volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 (73feeff7-7c44-4918-b54c-a30ca8ce0119): created successfully Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23fe11cb-0577-49bd-a704-7344aaf90170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Flow 'volume_create_manager' (b158de0a-a4d4-47dd-baaf-355d8d7e6269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b182781c-96b3-4310-9101-fc7d24835f08 tempest-AttachVolumeTestJSON-228910636 None] Created volume successfully. Sep 01 02:01:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2e7e1d61-1b99-4ddd-967e-09667054aaba req-392c2d08-88c2-4f12-b8e7-7fa2987c4fd1 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2e7e1d61-1b99-4ddd-967e-09667054aaba req-392c2d08-88c2-4f12-b8e7-7fa2987c4fd1 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2e7e1d61-1b99-4ddd-967e-09667054aaba req-392c2d08-88c2-4f12-b8e7-7fa2987c4fd1 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2e7e1d61-1b99-4ddd-967e-09667054aaba req-392c2d08-88c2-4f12-b8e7-7fa2987c4fd1 tempest-AttachVolumeTestJSON-228910636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-73feeff7-7c44-4918-b54c-a30ca8ce0119', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '650c9b61-8071-4be2-bbe5-a0d3331e2ea6', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:01:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-2e7e1d61-1b99-4ddd-967e-09667054aaba req-392c2d08-88c2-4f12-b8e7-7fa2987c4fd1 tempest-AttachVolumeTestJSON-228910636 None] attachment_update completed successfully. Sep 01 02:02:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-ba0a5bcf-317a-4e02-8c35-7431522561a8 req-c21e8c6e-3e7e-4627-993a-723a3c0f25db tempest-ServerActionsTestOtherA-91937418 None] Terminate volume connection completed successfully. Sep 01 02:02:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-ba0a5bcf-317a-4e02-8c35-7431522561a8 req-c21e8c6e-3e7e-4627-993a-723a3c0f25db tempest-ServerActionsTestOtherA-91937418 None] Deleting attachment c24684fb-8404-4552-aab6-1f4a2e3fc6d6. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Flow 'volume_create_manager' (c148f7cd-2a94-4cd5-9d42-ae51237bc095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96567274-057b-4e28-a7f5-64ca05ac9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96567274-057b-4e28-a7f5-64ca05ac9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1626835112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c25ffa-dbb9-451f-befc-ee1db8a80871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604ecfe8280641e88defd92b936cc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:04Z,use_quota=True,user_id='60c4cf4327024bc790bcf9679d143459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7e2506-8ecd-4fa2-a0d1-121499208dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7e2506-8ecd-4fa2-a0d1-121499208dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe4952c-1594-4942-8e69-3a5b524bf419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe4952c-1594-4942-8e69-3a5b524bf419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c25ffa-dbb9-451f-befc-ee1db8a80871', 'volume_name': 'volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8fb237-6f1a-4918-9bf1-f9babf20ebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8fb237-6f1a-4918-9bf1-f9babf20ebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4884eb-5be7-43ce-aff0-6f7237550a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Volume d0c25ffa-dbb9-451f-befc-ee1db8a80871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871', 'volume_size': 1} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1626835112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c25ffa-dbb9-451f-befc-ee1db8a80871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604ecfe8280641e88defd92b936cc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:04Z,use_quota=True,user_id='60c4cf4327024bc790bcf9679d143459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Creating volume d0c25ffa-dbb9-451f-befc-ee1db8a80871 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:04 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:02:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:04 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 1073741824 Sep 01 02:02:04 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:05 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 1073741824" returned: 0 in 0.971s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:05 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 Sep 01 02:02:05 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:06 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871" returned: 0 in 0.641s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4884eb-5be7-43ce-aff0-6f7237550a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc010dd1-7873-41ce-8df8-d4c8c7088da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:06 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Volume volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 (d0c25ffa-dbb9-451f-befc-ee1db8a80871): created successfully Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc010dd1-7873-41ce-8df8-d4c8c7088da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Flow 'volume_create_manager' (c148f7cd-2a94-4cd5-9d42-ae51237bc095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2d4fae8a-64b6-4546-963d-edeb4fee6b7b tempest-VolumesMetadataTest-361877201 None] Created volume successfully. Sep 01 02:02:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Acquiring lock "cinder-d0c25ffa-dbb9-451f-befc-ee1db8a80871-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Lock "cinder-d0c25ffa-dbb9-451f-befc-ee1db8a80871-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Acquiring lock "cinder-quobyte-d0c25ffa-dbb9-451f-befc-ee1db8a80871" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Lock "cinder-quobyte-d0c25ffa-dbb9-451f-befc-ee1db8a80871" acquired by "delete_volume" :: waited 0.055s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:10 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46d59cd-302d-4ac2-9c17-c8205b30671a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:11 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 Sep 01 02:02:11 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:11 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871" returned: 0 in 0.676s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:11 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871 Sep 01 02:02:11 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:12 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d0c25ffa-dbb9-451f-befc-ee1db8a80871" returned: 0 in 0.449s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Lock "cinder-quobyte-d0c25ffa-dbb9-451f-befc-ee1db8a80871" released by "delete_volume" :: held 1.280s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Created reservations ['4647b9cc-a534-412b-a595-eac098727015', 'c2c1dae8-d260-416f-ab14-3bcb1d82a2e4', '982fae93-8c04-46a4-8bdd-e548828a969a', 'c118b31c-a0d0-4dc8-81e8-0a11ffb4bf1b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:12 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:02:12 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:13 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.973s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:13 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:13 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Deleted volume successfully. Sep 01 02:02:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1c44a649-9723-4c2d-8aa5-6ddd4393bde1 tempest-VolumesMetadataTest-361877201 None] Lock "cinder-d0c25ffa-dbb9-451f-befc-ee1db8a80871-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=48,cinder:UPDATE=45,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Flow 'volume_create_manager' (cd281588-2b4c-4001-a28f-16eaa330a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fc28ff-08bc-4102-8b1f-fd0ba906df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fc28ff-08bc-4102-8b1f-fd0ba906df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1297359206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e031e57-c328-4651-b193-9c1e88883c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0607334b4e5548c3b7433dde38b659a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:18Z,use_quota=True,user_id='0cccc4f2b35144e1a2a7adc043b3fb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7236dd-f8b1-4273-9530-8f355bdb4271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7236dd-f8b1-4273-9530-8f355bdb4271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118203b9-afe8-4949-b9a7-944628021590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:18 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118203b9-afe8-4949-b9a7-944628021590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e031e57-c328-4651-b193-9c1e88883c2d', 'volume_name': 'volume-4e031e57-c328-4651-b193-9c1e88883c2d', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb7c37c-c98b-4d4e-9941-24e9eda11367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb7c37c-c98b-4d4e-9941-24e9eda11367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543356fe-8363-4aaa-98ac-df53a8303083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Volume 4e031e57-c328-4651-b193-9c1e88883c2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e031e57-c328-4651-b193-9c1e88883c2d', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Trying to clone 4e031e57-c328-4651-b193-9c1e88883c2d from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Flow 'volume_create_manager' (ddef1c1d-7daf-421e-9e20-0d05f2aad1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ac9131-1c54-47ea-87b2-e2d6999d3e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ac9131-1c54-47ea-87b2-e2d6999d3e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-228551664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9e5180-0b42-429b-b336-3d1c9f39cf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3f686a19d5414695a30de30db3b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:20Z,use_quota=True,user_id='deb43518a55848ddb1142cd17ac0cb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f860f013-4fc3-49c3-9136-1685f02722eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f860f013-4fc3-49c3-9136-1685f02722eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c991eaf-3e19-4664-993c-3bae0ba8c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c991eaf-3e19-4664-993c-3bae0ba8c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9e5180-0b42-429b-b336-3d1c9f39cf15', 'volume_name': 'volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d68ea9-7989-4d0a-aa99-99719966ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d68ea9-7989-4d0a-aa99-99719966ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a3b7b0-fad7-4c4c-9690-aa26820e5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Volume 6d9e5180-0b42-429b-b336-3d1c9f39cf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15', 'volume_size': 1} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-228551664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9e5180-0b42-429b-b336-3d1c9f39cf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3f686a19d5414695a30de30db3b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:20Z,use_quota=True,user_id='deb43518a55848ddb1142cd17ac0cb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Creating volume 6d9e5180-0b42-429b-b336-3d1c9f39cf15 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:19 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:19 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 1073741824 Sep 01 02:02:19 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:19 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:02:19 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6970720f-57e9-4d72-a7ef-0d4e4759e24e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:20 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD Sep 01 02:02:20 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:20 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 1073741824" returned: 0 in 0.751s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:20 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD" returned: 0 in 0.607s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 is fetched for user 0cccc4f2b35144e1a2a7adc043b3fb2b. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:20 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 Sep 01 02:02:20 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[49789363-58ea-4334-88ef-ab5fb032109f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:20 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD Sep 01 02:02:20 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:21 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15" returned: 0 in 0.340s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a3b7b0-fad7-4c4c-9690-aa26820e5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a5e41-e7bb-499b-84ea-41ca0e792041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Volume volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 (6d9e5180-0b42-429b-b336-3d1c9f39cf15): created successfully Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a5e41-e7bb-499b-84ea-41ca0e792041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Flow 'volume_create_manager' (ddef1c1d-7daf-421e-9e20-0d05f2aad1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0524fd33-d44d-4817-84dd-bb063988eaf7 tempest-ServerRescueNegativeTestJSON-363876516 None] Created volume successfully. Sep 01 02:02:21 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1297359206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e031e57-c328-4651-b193-9c1e88883c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0607334b4e5548c3b7433dde38b659a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:18Z,use_quota=True,user_id='0cccc4f2b35144e1a2a7adc043b3fb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Creating volume 4e031e57-c328-4651-b193-9c1e88883c2d {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:21 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:02:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:21 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d 1073741824 Sep 01 02:02:21 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:22 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d 1073741824" returned: 0 in 0.993s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:22 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d Sep 01 02:02:22 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:23 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d" returned: 0 in 0.574s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Attempting download of d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume 4e031e57-c328-4651-b193-9c1e88883c2d. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c18bde7-a446-466e-8bd5-a1e530c21980]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:23 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm Sep 01 02:02:23 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:23 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm" returned: 0 in 0.577s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:23 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm Sep 01 02:02:23 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Flow 'volume_create_manager' (210ee4a6-80c5-41a2-9111-dc7ce99170ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537ed864-a7e0-4894-bbf0-6a26c0aded5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:24 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537ed864-a7e0-4894-bbf0-6a26c0aded5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-480700012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e87fb5a-ea32-4ecb-95be-cf847cd587ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a928f3b2d645549fd354a115fcfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:24Z,use_quota=True,user_id='5b2857439a60410daca95411b1af7837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72facaef-ec3d-4e30-8a99-04f954fb8ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72facaef-ec3d-4e30-8a99-04f954fb8ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e1dbcd-60c0-4f51-910b-1804f227bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e1dbcd-60c0-4f51-910b-1804f227bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e87fb5a-ea32-4ecb-95be-cf847cd587ed', 'volume_name': 'volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f24efb-d40f-4d52-8d8c-65b69016a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f24efb-d40f-4d52-8d8c-65b69016a68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fc77f0-fd4a-46b6-8a06-63b057291b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Volume 1e87fb5a-ea32-4ecb-95be-cf847cd587ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed', 'volume_size': 1} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-480700012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e87fb5a-ea32-4ecb-95be-cf847cd587ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a928f3b2d645549fd354a115fcfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:24Z,use_quota=True,user_id='5b2857439a60410daca95411b1af7837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Creating volume 1e87fb5a-ea32-4ecb-95be-cf847cd587ed {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:24 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm" returned: 1 in 0.649s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_88as8fcm' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c5d25c-b5fb-45c1-856e-1bc82fe7f5cc]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:24 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed 1073741824 Sep 01 02:02:24 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:24 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD Sep 01 02:02:24 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:25 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:25 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 was qcow2, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:02:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:25 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d Sep 01 02:02:25 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:25 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed 1073741824" returned: 0 in 1.147s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:25 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed Sep 01 02:02:25 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:26 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed" returned: 0 in 0.616s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fc77f0-fd4a-46b6-8a06-63b057291b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff9d2ed-abe7-4a83-a2fd-a9bb6d1b425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Volume volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed (1e87fb5a-ea32-4ecb-95be-cf847cd587ed): created successfully Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff9d2ed-abe7-4a83-a2fd-a9bb6d1b425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Flow 'volume_create_manager' (210ee4a6-80c5-41a2-9111-dc7ce99170ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-05b8a40b-1e55-4741-b7c3-42a32422a503 tempest-VolumesTransfersV357Test-2033497264 None] Created volume successfully. Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:28 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:02:28 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-37a9af96-e8ec-4492-9793-56e341cec8cd tempest-VolumesTransfersV357Test-833438116 None] Transfer volume completed successfully. Sep 01 02:02:28 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d" returned: 0 in 3.573s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_bcz7te90devstack@QuobyteHD, size 112.00 MB, duration 3.57 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:02:28 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Converted 112.00 MB image at 31.34 MB/s Sep 01 02:02:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:28 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d 1G Sep 01 02:02:28 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:29 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.628s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:02:29 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d 1G" returned: 0 in 1.036s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Downloaded image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume 4e031e57-c328-4651-b193-9c1e88883c2d successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 for user 0cccc4f2b35144e1a2a7adc043b3fb2b is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Marking volume 4e031e57-c328-4651-b193-9c1e88883c2d as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Acquiring lock "cinder-1e87fb5a-ea32-4ecb-95be-cf847cd587ed-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-1e87fb5a-ea32-4ecb-95be-cf847cd587ed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Copying metadata from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 to 4e031e57-c328-4651-b193-9c1e88883c2d. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Creating volume glance metadata for volume 4e031e57-c328-4651-b193-9c1e88883c2d backed by image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:02:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Acquiring lock "cinder-quobyte-1e87fb5a-ea32-4ecb-95be-cf847cd587ed" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-quobyte-1e87fb5a-ea32-4ecb-95be-cf847cd587ed" acquired by "delete_volume" :: waited 0.049s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d420ef9-36ac-4eb9-babb-48ad7b6d67bc]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543356fe-8363-4aaa-98ac-df53a8303083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e031e57-c328-4651-b193-9c1e88883c2d', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c767a0-3c2c-4a10-98f3-a48c8d4dccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:30 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Volume volume-4e031e57-c328-4651-b193-9c1e88883c2d (4e031e57-c328-4651-b193-9c1e88883c2d): created successfully Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c767a0-3c2c-4a10-98f3-a48c8d4dccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:30 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed Sep 01 02:02:30 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Flow 'volume_create_manager' (cd281588-2b4c-4001-a28f-16eaa330a718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5d9fc63a-d231-4f91-9bdd-d38ebbe0678a tempest-ServerActionsTestOtherA-91937418 None] Created volume successfully. Sep 01 02:02:30 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed" returned: 0 in 0.725s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:30 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed Sep 01 02:02:30 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:31 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1e87fb5a-ea32-4ecb-95be-cf847cd587ed" returned: 0 in 0.466s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-quobyte-1e87fb5a-ea32-4ecb-95be-cf847cd587ed" released by "delete_volume" :: held 1.315s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Created reservations ['ccf4dc4d-c3c1-49ac-a05a-fef934690442', '0962012a-492a-4410-9414-2330ae68211f', 'bec62d8f-1ffe-4dea-996c-384e613c00cf', '8469485c-c56a-408f-80a1-667205481374'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:31 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:02:31 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:32 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.441s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:32 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Deleted volume successfully. Sep 01 02:02:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1f21ae06-071c-483e-89f1-db97c9e29126 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-1e87fb5a-ea32-4ecb-95be-cf847cd587ed-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Flow 'volume_create_manager' (34fcd236-bd48-4d99-85fa-c6401d5b47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d7c634-cd95-4cd1-bbf9-e9c0498e7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d7c634-cd95-4cd1-bbf9-e9c0498e7144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1813361648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31bc274-5e83-4cd1-a9c4-255e966f80b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a928f3b2d645549fd354a115fcfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:33Z,use_quota=True,user_id='5b2857439a60410daca95411b1af7837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0b7ee2-1fd6-471f-ba0a-6690764c9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0b7ee2-1fd6-471f-ba0a-6690764c9884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a489d5-1da2-49c5-a7d0-b71dc42af049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a489d5-1da2-49c5-a7d0-b71dc42af049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31bc274-5e83-4cd1-a9c4-255e966f80b3', 'volume_name': 'volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1191928-b66e-44ef-8ad4-b28d71b1eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1191928-b66e-44ef-8ad4-b28d71b1eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a57f6da-bd82-4ccd-b9be-8e86c09b91dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Volume a31bc274-5e83-4cd1-a9c4-255e966f80b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3', 'volume_size': 1} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1813361648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31bc274-5e83-4cd1-a9c4-255e966f80b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a928f3b2d645549fd354a115fcfdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:33Z,use_quota=True,user_id='5b2857439a60410daca95411b1af7837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Creating volume a31bc274-5e83-4cd1-a9c4-255e966f80b3 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:33 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:02:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:33 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 1073741824 Sep 01 02:02:33 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:34 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 1073741824" returned: 0 in 0.844s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:34 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 Sep 01 02:02:34 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:34 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3" returned: 0 in 0.335s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a57f6da-bd82-4ccd-b9be-8e86c09b91dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226fef28-2c39-4012-b5eb-d1e8a56b09fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Volume volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 (a31bc274-5e83-4cd1-a9c4-255e966f80b3): created successfully Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226fef28-2c39-4012-b5eb-d1e8a56b09fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Flow 'volume_create_manager' (34fcd236-bd48-4d99-85fa-c6401d5b47ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-89e7c7ab-0a30-4eb8-a2f2-2958dff4f759 tempest-VolumesTransfersV357Test-2033497264 None] Created volume successfully. Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Acquiring lock "cinder-6d9e5180-0b42-429b-b336-3d1c9f39cf15-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "cinder-6d9e5180-0b42-429b-b336-3d1c9f39cf15-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-84cf7695-6898-424f-ad34-6ccad60b02d0 req-e88b2998-aed8-44d9-86b6-c19035d781a2 tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-84cf7695-6898-424f-ad34-6ccad60b02d0 req-e88b2998-aed8-44d9-86b6-c19035d781a2 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-84cf7695-6898-424f-ad34-6ccad60b02d0 req-e88b2998-aed8-44d9-86b6-c19035d781a2 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Acquiring lock "cinder-quobyte-6d9e5180-0b42-429b-b336-3d1c9f39cf15" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-84cf7695-6898-424f-ad34-6ccad60b02d0 req-e88b2998-aed8-44d9-86b6-c19035d781a2 tempest-ServerActionsTestOtherA-91937418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-4e031e57-c328-4651-b193-9c1e88883c2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '438b68e2-c386-4f7b-b004-56e131d68172', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "cinder-quobyte-6d9e5180-0b42-429b-b336-3d1c9f39cf15" acquired by "delete_volume" :: waited 0.051s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb81964-90c4-4ded-98b9-b809b7bb855b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-84cf7695-6898-424f-ad34-6ccad60b02d0 req-e88b2998-aed8-44d9-86b6-c19035d781a2 tempest-ServerActionsTestOtherA-91937418 None] attachment_update completed successfully. Sep 01 02:02:35 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 Sep 01 02:02:35 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:36 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15" returned: 0 in 0.752s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:36 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15 Sep 01 02:02:36 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Acquiring lock "cinder-a31bc274-5e83-4cd1-a9c4-255e966f80b3-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-a31bc274-5e83-4cd1-a9c4-255e966f80b3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Acquiring lock "cinder-quobyte-a31bc274-5e83-4cd1-a9c4-255e966f80b3" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-quobyte-a31bc274-5e83-4cd1-a9c4-255e966f80b3" acquired by "delete_volume" :: waited 0.057s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:36 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6d9e5180-0b42-429b-b336-3d1c9f39cf15" returned: 0 in 0.538s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "cinder-quobyte-6d9e5180-0b42-429b-b336-3d1c9f39cf15" released by "delete_volume" :: held 1.395s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdaf85e-65fb-44c5-8717-00ef73c2ba61]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:36 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Created reservations ['c0587a5e-1efb-41a4-9047-72abb5e64701', '4162d23f-4417-4a77-83c4-d9ec150e9fe3', 'd657ce1c-d85e-4980-b10d-3432dfdd8a61', '3372631f-76fd-46db-b1f9-eadffa875e6b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:37 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:37 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:37 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:02:37 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:37 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3" returned: 0 in 0.823s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:37 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3 Sep 01 02:02:37 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:37 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.717s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Deleted volume successfully. Sep 01 02:02:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-300a3503-2f7f-4c7a-bb79-01c477781ba5 tempest-ServerRescueNegativeTestJSON-363876516 None] Lock "cinder-6d9e5180-0b42-429b-b336-3d1c9f39cf15-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:38 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a31bc274-5e83-4cd1-a9c4-255e966f80b3" returned: 0 in 0.681s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-quobyte-a31bc274-5e83-4cd1-a9c4-255e966f80b3" released by "delete_volume" :: held 1.641s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Created reservations ['c49db2f7-53f6-4dd2-9b81-2c41ba957f54', '941a250a-bc59-43db-a0d9-45a09dd34c45', '34ce4388-173d-4cf5-9395-167458c236cf', '2c763f0b-3afb-4554-8069-21d8aa076d22'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:39 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:02:39 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:40 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 1.095s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:40 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Deleted volume successfully. Sep 01 02:02:40 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2b15b90c-e394-4dd9-aabb-8af8b18173c5 tempest-VolumesTransfersV357Test-1674445794 None] Lock "cinder-a31bc274-5e83-4cd1-a9c4-255e966f80b3-delete_volume" released by "delete_volume" :: held 3.654s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:48 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=33,cinder:UPDATE=39,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=66,cinder:UPDATE=65,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Flow 'volume_create_manager' (202db195-1627-41ec-a49c-bb3de099b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ee6615-26a2-4e51-9802-2eab39d5ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ee6615-26a2-4e51-9802-2eab39d5ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-956744806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35783e87-935e-496f-9bb3-3212adafa73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f02eaa08544f9596e545910d81ea64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:51Z,use_quota=True,user_id='ea4295852e094cec80bc7e1726a4ca6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725e26e0-13cf-41c3-a07c-cabebbb653f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725e26e0-13cf-41c3-a07c-cabebbb653f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d29ce1-f541-49d8-af0a-b21b77180fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d29ce1-f541-49d8-af0a-b21b77180fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35783e87-935e-496f-9bb3-3212adafa73f', 'volume_name': 'volume-35783e87-935e-496f-9bb3-3212adafa73f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd515565-1acd-4d00-9f6c-9a44c274dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd515565-1acd-4d00-9f6c-9a44c274dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acba36d4-0c9e-47c7-9ef9-c3c57476902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Volume 35783e87-935e-496f-9bb3-3212adafa73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35783e87-935e-496f-9bb3-3212adafa73f', 'volume_size': 1} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-956744806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35783e87-935e-496f-9bb3-3212adafa73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f02eaa08544f9596e545910d81ea64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:51Z,use_quota=True,user_id='ea4295852e094cec80bc7e1726a4ca6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Creating volume 35783e87-935e-496f-9bb3-3212adafa73f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:50 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:02:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:51 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f 1073741824 Sep 01 02:02:51 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:51 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f 1073741824" returned: 0 in 0.789s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:51 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f Sep 01 02:02:51 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:52 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f" returned: 0 in 0.477s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acba36d4-0c9e-47c7-9ef9-c3c57476902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35783e87-935e-496f-9bb3-3212adafa73f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a18b55-d401-4689-ab26-007ce104a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Volume volume-35783e87-935e-496f-9bb3-3212adafa73f (35783e87-935e-496f-9bb3-3212adafa73f): created successfully Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a18b55-d401-4689-ab26-007ce104a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Flow 'volume_create_manager' (202db195-1627-41ec-a49c-bb3de099b7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5b865064-db52-4729-96a5-b6e3690d262d tempest-VolumesNegativeTest-423221525 None] Created volume successfully. Sep 01 02:02:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-21055380-4510-44b1-91e2-1a09c128a16e req-a3a5024e-bde4-4b01-9346-35767ad5530e tempest-AttachVolumeTestJSON-228910636 None] Terminate volume connection completed successfully. Sep 01 02:02:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-21055380-4510-44b1-91e2-1a09c128a16e req-a3a5024e-bde4-4b01-9346-35767ad5530e tempest-AttachVolumeTestJSON-228910636 None] Deleting attachment 650c9b61-8071-4be2-bbe5-a0d3331e2ea6. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-c8f55335-90d8-4e1f-8b56-9e5b0bddb0d0 tempest-ServerActionsTestOtherA-91937418 None] Terminate volume connection completed successfully. Sep 01 02:03:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-c8f55335-90d8-4e1f-8b56-9e5b0bddb0d0 tempest-ServerActionsTestOtherA-91937418 None] Deleting attachment 438b68e2-c386-4f7b-b004-56e131d68172. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Flow 'volume_create_manager' (05030ec4-6917-44f7-88c5-36e2f4dd4a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a3edcf-0b59-42b5-8709-30f4a3d4dfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a3edcf-0b59-42b5-8709-30f4a3d4dfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-983538835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d628f67a-5017-4ea6-8e5c-b9bf080ddccf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1e45ec6449146f9afea411d60082026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:04Z,use_quota=True,user_id='b2091f4d387944dfbde30d163912a199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9aff605-7484-43a0-92ac-0cb46d497699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9aff605-7484-43a0-92ac-0cb46d497699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f1681b-a685-497d-a9b1-8a209269a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f1681b-a685-497d-a9b1-8a209269a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd628f67a-5017-4ea6-8e5c-b9bf080ddccf', 'volume_name': 'volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a67b582-8744-4b81-be4a-e0740b7dc088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a67b582-8744-4b81-be4a-e0740b7dc088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07343af0-5f6b-4725-b300-d396b1cc4fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Volume d628f67a-5017-4ea6-8e5c-b9bf080ddccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf', 'volume_size': 1} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-983538835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d628f67a-5017-4ea6-8e5c-b9bf080ddccf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1e45ec6449146f9afea411d60082026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:04Z,use_quota=True,user_id='b2091f4d387944dfbde30d163912a199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Creating volume d628f67a-5017-4ea6-8e5c-b9bf080ddccf {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:04 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:03:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:04 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf 1073741824 Sep 01 02:03:04 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:05 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf 1073741824" returned: 0 in 1.257s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:05 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf Sep 01 02:03:05 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:06 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf" returned: 0 in 0.481s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07343af0-5f6b-4725-b300-d396b1cc4fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d33c7a7-d389-4a9a-88f7-62befa34de89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:06 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Volume volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf (d628f67a-5017-4ea6-8e5c-b9bf080ddccf): created successfully Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d33c7a7-d389-4a9a-88f7-62befa34de89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Flow 'volume_create_manager' (05030ec4-6917-44f7-88c5-36e2f4dd4a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-70005831-ca55-4ad6-8363-5f24172c5a37 tempest-VolumesTestJSON-143348376 None] Created volume successfully. Sep 01 02:03:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-542b1222-e9a1-4684-b656-ff92cf7cde7a tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-542b1222-e9a1-4684-b656-ff92cf7cde7a tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-542b1222-e9a1-4684-b656-ff92cf7cde7a tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.146s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-542b1222-e9a1-4684-b656-ff92cf7cde7a tempest-ServerActionsTestOtherA-91937418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-4e031e57-c328-4651-b193-9c1e88883c2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c35e6c25-b32f-4bb7-9807-b890ed9d30e8', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-ebd2e672-f8cc-4d02-ba09-ae04db550f26 req-542b1222-e9a1-4684-b656-ff92cf7cde7a tempest-ServerActionsTestOtherA-91937418 None] attachment_update completed successfully. Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Flow 'volume_create_manager' (c787d1d4-39df-4f5b-91a4-cc3881b1b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33855ab-34ae-41b8-bffd-f4eff585ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33855ab-34ae-41b8-bffd-f4eff585ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-274420079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8e8986-507a-4d60-b2ce-f3ea1a8920e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1e45ec6449146f9afea411d60082026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:10Z,use_quota=True,user_id='b2091f4d387944dfbde30d163912a199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5847646c-f15e-4130-968b-1e75cdb4a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5847646c-f15e-4130-968b-1e75cdb4a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c395e7-d108-4296-a6a1-5d8275082939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c395e7-d108-4296-a6a1-5d8275082939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8e8986-507a-4d60-b2ce-f3ea1a8920e9', 'volume_name': 'volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375b6164-dabd-4a42-bf7e-8ebf680d4b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375b6164-dabd-4a42-bf7e-8ebf680d4b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afa7895-e770-4d0c-a83e-3b1cb75a8a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:10 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Volume 2d8e8986-507a-4d60-b2ce-f3ea1a8920e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9', 'volume_size': 1} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-274420079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8e8986-507a-4d60-b2ce-f3ea1a8920e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1e45ec6449146f9afea411d60082026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:10Z,use_quota=True,user_id='b2091f4d387944dfbde30d163912a199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Creating volume 2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:10 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:03:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:10 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 1073741824 Sep 01 02:03:10 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:12 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 1073741824" returned: 0 in 1.613s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:12 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 Sep 01 02:03:12 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:12 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9" returned: 0 in 0.525s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afa7895-e770-4d0c-a83e-3b1cb75a8a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a6b8f8-93ac-4d6e-b64c-824b3d40ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:13 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Volume volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 (2d8e8986-507a-4d60-b2ce-f3ea1a8920e9): created successfully Sep 01 02:03:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a6b8f8-93ac-4d6e-b64c-824b3d40ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Flow 'volume_create_manager' (c787d1d4-39df-4f5b-91a4-cc3881b1b68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:13 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c5c8bbd5-78f9-449d-9a82-6aaea171cfab tempest-VolumesTestJSON-143348376 None] Created volume successfully. Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Flow 'volume_create_manager' (a95d2662-f02d-492c-b6dd-82107e71f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe25a04-5922-43ee-aadc-4768ddf6ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe25a04-5922-43ee-aadc-4768ddf6ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-686948445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b69cd2-85c1-479b-930d-4978bb0fe989,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1e45ec6449146f9afea411d60082026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:15Z,use_quota=True,user_id='b2091f4d387944dfbde30d163912a199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e9fc8-b223-4528-92c4-e52a72829c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e9fc8-b223-4528-92c4-e52a72829c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5779738-fc08-4e07-a54f-809e12761ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5779738-fc08-4e07-a54f-809e12761ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b69cd2-85c1-479b-930d-4978bb0fe989', 'volume_name': 'volume-19b69cd2-85c1-479b-930d-4978bb0fe989', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bfd395-64ec-4ad1-b15a-02f6fbc4415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bfd395-64ec-4ad1-b15a-02f6fbc4415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df383455-b443-4a5e-93e6-b9af07ae3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Volume 19b69cd2-85c1-479b-930d-4978bb0fe989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b69cd2-85c1-479b-930d-4978bb0fe989', 'volume_size': 1} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-686948445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b69cd2-85c1-479b-930d-4978bb0fe989,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1e45ec6449146f9afea411d60082026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:15Z,use_quota=True,user_id='b2091f4d387944dfbde30d163912a199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Creating volume 19b69cd2-85c1-479b-930d-4978bb0fe989 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:15 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:03:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:15 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 1073741824 Sep 01 02:03:15 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:16 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 1073741824" returned: 0 in 1.172s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:16 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 Sep 01 02:03:16 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:17 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989" returned: 0 in 0.411s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df383455-b443-4a5e-93e6-b9af07ae3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b69cd2-85c1-479b-930d-4978bb0fe989', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a330be-e66e-42f4-bb1f-2dec4313b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Volume volume-19b69cd2-85c1-479b-930d-4978bb0fe989 (19b69cd2-85c1-479b-930d-4978bb0fe989): created successfully Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a330be-e66e-42f4-bb1f-2dec4313b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Flow 'volume_create_manager' (a95d2662-f02d-492c-b6dd-82107e71f542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-589dc42b-3d11-4fd3-a92c-c92a964568bf tempest-VolumesTestJSON-143348376 None] Created volume successfully. Sep 01 02:03:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Acquiring lock "cinder-19b69cd2-85c1-479b-930d-4978bb0fe989-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Lock "cinder-19b69cd2-85c1-479b-930d-4978bb0fe989-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Acquiring lock "cinder-quobyte-19b69cd2-85c1-479b-930d-4978bb0fe989" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Lock "cinder-quobyte-19b69cd2-85c1-479b-930d-4978bb0fe989" acquired by "delete_volume" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:20 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b58ea6-ecfb-413b-a3fb-4f138f49c8b9]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:20 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 Sep 01 02:03:20 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:21 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989" returned: 0 in 0.791s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:21 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989 Sep 01 02:03:21 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:21 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-19b69cd2-85c1-479b-930d-4978bb0fe989" returned: 0 in 0.842s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Lock "cinder-quobyte-19b69cd2-85c1-479b-930d-4978bb0fe989" released by "delete_volume" :: held 1.731s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Created reservations ['ab3429b4-e813-41be-9216-edd96d0aec50', '5f1f060b-6638-43e6-b2d6-3f0a4c9df6d8', '97596424-9284-4c87-b946-9fc5ac94cb1c', '000b5507-3406-4398-a490-0aab73dd7e5e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:22 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:22 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:22 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.294s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:22 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Deleted volume successfully. Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4476a9b7-b614-47de-a775-36210a7fe064 tempest-VolumesTestJSON-143348376 None] Lock "cinder-19b69cd2-85c1-479b-930d-4978bb0fe989-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Acquiring lock "cinder-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Lock "cinder-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Acquiring lock "cinder-quobyte-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Lock "cinder-quobyte-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d06b749-8b6b-401f-ad6c-016063370a97]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:22 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 Sep 01 02:03:22 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:23 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9" returned: 0 in 0.675s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:23 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9 Sep 01 02:03:23 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:23 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9" returned: 0 in 0.397s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Lock "cinder-quobyte-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9" released by "delete_volume" :: held 1.134s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:23 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Created reservations ['ff15586f-067c-4b0a-a177-f1b64aa67944', '9eb72fb6-da78-42fc-a02d-1f3c48a53ece', '1ec72cdc-9d6c-40ee-b4cc-205d598bd34d', 'fda0afc9-79ee-418e-821e-407ba6e50a9a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:24 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:24 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:24 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.288s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Deleted volume successfully. Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0451f31e-868d-4b31-bfe8-8776da40d616 tempest-VolumesTestJSON-143348376 None] Lock "cinder-2d8e8986-507a-4d60-b2ce-f3ea1a8920e9-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Acquiring lock "cinder-d628f67a-5017-4ea6-8e5c-b9bf080ddccf-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Lock "cinder-d628f67a-5017-4ea6-8e5c-b9bf080ddccf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Acquiring lock "cinder-quobyte-d628f67a-5017-4ea6-8e5c-b9bf080ddccf" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Lock "cinder-quobyte-d628f67a-5017-4ea6-8e5c-b9bf080ddccf" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[56639b01-904f-4998-8d27-0972004b4035]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:25 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf Sep 01 02:03:25 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:25 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf" returned: 0 in 0.443s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:25 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf Sep 01 02:03:25 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:25 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d628f67a-5017-4ea6-8e5c-b9bf080ddccf" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Lock "cinder-quobyte-d628f67a-5017-4ea6-8e5c-b9bf080ddccf" released by "delete_volume" :: held 0.800s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:25 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Created reservations ['64deea00-bd04-41ba-8a29-0b99a7bbb0c4', 'bd1385ea-25c5-43d5-bcb1-432b2ccdd92b', '052a72cf-f1e4-4db2-8653-c87d19d099ea', '6daad1fc-a34c-4987-bc64-f87c705b7cb1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:26 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:26 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:26 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Deleted volume successfully. Sep 01 02:03:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db136059-c4f8-4b80-9f74-529c4e84e8cf tempest-VolumesTestJSON-143348376 None] Lock "cinder-d628f67a-5017-4ea6-8e5c-b9bf080ddccf-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Acquiring lock "cinder-35783e87-935e-496f-9bb3-3212adafa73f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Lock "cinder-35783e87-935e-496f-9bb3-3212adafa73f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Acquiring lock "cinder-quobyte-35783e87-935e-496f-9bb3-3212adafa73f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Lock "cinder-quobyte-35783e87-935e-496f-9bb3-3212adafa73f" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d659b2-a664-413f-bef3-4435c85cbe66]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:28 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f Sep 01 02:03:28 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:28 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:28 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:28 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f" returned: 0 in 0.477s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:28 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f Sep 01 02:03:28 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:28 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:03:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:03:29 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35783e87-935e-496f-9bb3-3212adafa73f" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Lock "cinder-quobyte-35783e87-935e-496f-9bb3-3212adafa73f" released by "delete_volume" :: held 0.936s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Created reservations ['74be60c0-499e-42e8-9268-da54a90d9489', '7e50be98-f7b4-4794-8f20-fb1e5d352314', '9efc2ebc-6d77-4947-896c-14f30eff37e3', 'a4dc6f20-b828-408c-bdc2-972930e2d8b6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:29 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:29 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Deleted volume successfully. Sep 01 02:03:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5f6042b6-2955-498d-ab32-39c2a87cfdcf tempest-VolumesNegativeTest-423221525 None] Lock "cinder-35783e87-935e-496f-9bb3-3212adafa73f-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8706446d-fbd2-4331-9c37-49f2b4e6f6e3 tempest-GroupSnapshotsV319Test-361412303 None] Group tempest-GroupSnapshotsV319Test-Group-188545988: creating Sep 01 02:03:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8706446d-fbd2-4331-9c37-49f2b4e6f6e3 tempest-GroupSnapshotsV319Test-361412303 None] Group tempest-GroupSnapshotsV319Test-Group-188545988: created successfully Sep 01 02:03:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8706446d-fbd2-4331-9c37-49f2b4e6f6e3 tempest-GroupSnapshotsV319Test-361412303 None] Create group completed successfully. Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Flow 'volume_create_manager' (ee24691a-3e1f-4173-915c-47f9360e995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fcbcd9-7d88-4cc1-b9e1-38bed4196102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fcbcd9-7d88-4cc1-b9e1-38bed4196102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-241778214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958349fb-22eb-466e-a178-103f4af71fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7175e4cea214bd897601dd1356b3a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:34Z,use_quota=True,user_id='fb85283cc5064aec99b12c01fc65fd91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6045df72-f941-4536-a91c-cb77f878b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6045df72-f941-4536-a91c-cb77f878b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b0cb0e-758e-496d-be0d-a39c1c1c8a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b0cb0e-758e-496d-be0d-a39c1c1c8a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958349fb-22eb-466e-a178-103f4af71fa8', 'volume_name': 'volume-958349fb-22eb-466e-a178-103f4af71fa8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f9d3e2-4da3-4c9a-8dc4-8f9d26cecd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f9d3e2-4da3-4c9a-8dc4-8f9d26cecd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2da5ca-96f3-4437-8430-160f70273ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Volume 958349fb-22eb-466e-a178-103f4af71fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958349fb-22eb-466e-a178-103f4af71fa8', 'volume_size': 1} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-241778214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958349fb-22eb-466e-a178-103f4af71fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7175e4cea214bd897601dd1356b3a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:34Z,use_quota=True,user_id='fb85283cc5064aec99b12c01fc65fd91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Creating volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:34 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:34 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 1073741824 Sep 01 02:03:34 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Flow 'volume_create_manager' (69c98346-5f95-4a52-9fdf-d15273c9555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a67e73-d2b8-4690-9257-0960f2c25e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a67e73-d2b8-4690-9257-0960f2c25e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65136338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24bd5a80-f8cd-4f1b-a1ed-158c9650a163,host='devstack@QuobyteHD#QuobyteHD',id=1b97f392-b767-40a4-bede-b8ad916b001c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886956f759534df98cde4820e29bf748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:34Z,use_quota=True,user_id='d1b43d2aa34344f4b35f54f2c95fc258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(026fb455-97b5-4caf-9c06-05d527461229),volume_type_id=026fb455-97b5-4caf-9c06-05d527461229)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e911a5f-8455-4b52-ae07-53a8077a40e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e911a5f-8455-4b52-ae07-53a8077a40e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef836c-64dc-4dc2-80fa-a45f3c20b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef836c-64dc-4dc2-80fa-a45f3c20b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b97f392-b767-40a4-bede-b8ad916b001c', 'volume_name': 'volume-1b97f392-b767-40a4-bede-b8ad916b001c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69694bbc-9836-4204-a0bf-aacf1d387b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69694bbc-9836-4204-a0bf-aacf1d387b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4769c3-d8ea-4db4-b245-b7ca62f91c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Volume 1b97f392-b767-40a4-bede-b8ad916b001c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b97f392-b767-40a4-bede-b8ad916b001c', 'volume_size': 1} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:34 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 1073741824" returned: 0 in 0.610s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:34 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 Sep 01 02:03:34 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:35 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8" returned: 0 in 0.300s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24bd5a80-f8cd-4f1b-a1ed-158c9650a163,created_at=2026-09-01T00:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65136338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24bd5a80-f8cd-4f1b-a1ed-158c9650a163,host='devstack@QuobyteHD#QuobyteHD',id=1b97f392-b767-40a4-bede-b8ad916b001c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886956f759534df98cde4820e29bf748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:34Z,use_quota=True,user_id='d1b43d2aa34344f4b35f54f2c95fc258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(026fb455-97b5-4caf-9c06-05d527461229),volume_type_id=026fb455-97b5-4caf-9c06-05d527461229)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Creating volume 1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:35 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2da5ca-96f3-4437-8430-160f70273ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958349fb-22eb-466e-a178-103f4af71fa8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:35 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c 1073741824 Sep 01 02:03:35 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbbdff7-3714-491a-bc07-83c210f97955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:35 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Volume volume-958349fb-22eb-466e-a178-103f4af71fa8 (958349fb-22eb-466e-a178-103f4af71fa8): created successfully Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbbdff7-3714-491a-bc07-83c210f97955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Flow 'volume_create_manager' (ee24691a-3e1f-4173-915c-47f9360e995b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c0f8dd70-6a73-492b-8d46-679b7d2d9d3c tempest-VolumesSnapshotListTestJSON-2098279371 None] Created volume successfully. Sep 01 02:03:35 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c 1073741824" returned: 0 in 0.726s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:36 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c Sep 01 02:03:36 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:36 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c" returned: 0 in 0.387s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.103s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4769c3-d8ea-4db4-b245-b7ca62f91c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b97f392-b767-40a4-bede-b8ad916b001c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5192e4-9920-43e6-a704-1bf9002bd349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Creating offline snapshot 4c72e715-7eb1-413e-9f52-a2c0b14110e4 of volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:03:36 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Volume volume-1b97f392-b767-40a4-bede-b8ad916b001c (1b97f392-b767-40a4-bede-b8ad916b001c): created successfully Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5192e4-9920-43e6-a704-1bf9002bd349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Flow 'volume_create_manager' (69c98346-5f95-4a52-9fdf-d15273c9555b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd21026-c983-4dae-acf4-97dd539334cb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2ca7bb66-d212-462e-8636-5d3046068c34 tempest-GroupSnapshotsV319Test-361412303 None] Created volume successfully. Sep 01 02:03:36 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 Sep 01 02:03:36 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:36 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8" returned: 0 in 0.447s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:36 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 1G Sep 01 02:03:36 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] GroupSnapshot e5e0bc40-eba7-4d15-9453-970b57586be0: creating. Sep 01 02:03:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Group snapshot e5e0bc40-eba7-4d15-9453-970b57586be0: creating. {{(pid=87404) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:03:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:37 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 1G" returned: 0 in 0.523s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:37 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:37 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:37 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.331s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:37 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 is being set with open permissions: ugo+rw Sep 01 02:03:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:37 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:37 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:38 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.289s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:38 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info Sep 01 02:03:38 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:38 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info" returned: 0 in 0.313s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:38 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info is being set with open permissions: ugo+rw Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:38 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info Sep 01 02:03:38 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:38 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.info" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.473s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Creating offline snapshot 3073ec51-2309-4751-8eaf-91c6f238f058 of volume 1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:03:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a3574cf4-3076-4f04-acfd-d1e205c09aae tempest-VolumesSnapshotListTestJSON-2098279371 None] Create snapshot completed successfully Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9acb5e-4327-4866-9711-fc59f236197b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:38 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c Sep 01 02:03:38 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:39 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c" returned: 0 in 0.423s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:39 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 1G Sep 01 02:03:39 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:39 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 1G" returned: 0 in 0.534s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b97f392-b767-40a4-bede-b8ad916b001c -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:39 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b97f392-b767-40a4-bede-b8ad916b001c -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 Sep 01 02:03:39 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:40 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b97f392-b767-40a4-bede-b8ad916b001c -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:40 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:03:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:40 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 Sep 01 02:03:40 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:40 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058" returned: 0 in 0.296s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:40 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info Sep 01 02:03:40 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:40 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info" returned: 0 in 0.299s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:40 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:03:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:40 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info Sep 01 02:03:40 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:41 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.info" returned: 0 in 0.348s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.399s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Creating offline snapshot d5728af8-b448-4622-8c07-618aa1d5aa2c of volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e680692-03c0-495a-8986-d46be3ea3835]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:41 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-49c043b7-ac86-411e-a7fb-bc12fd6ef39e tempest-GroupSnapshotsV319Test-361412303 None] group_snapshot e5e0bc40-eba7-4d15-9453-970b57586be0: created successfully Sep 01 02:03:41 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:41 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:41 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.540s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:41 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c 1G Sep 01 02:03:41 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:42 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] group_snapshot e5e0bc40-eba7-4d15-9453-970b57586be0: deleting Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] group_snapshot e5e0bc40-eba7-4d15-9453-970b57586be0: deleting {{(pid=87404) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "cinder-quobyte-1b97f392-b767-40a4-bede-b8ad916b001c" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Lock "cinder-quobyte-1b97f392-b767-40a4-bede-b8ad916b001c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "cinder-quobyte-3073ec51-2309-4751-8eaf-91c6f238f058" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Lock "cinder-quobyte-3073ec51-2309-4751-8eaf-91c6f238f058" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Deleting offline snapshot 3073ec51-2309-4751-8eaf-91c6f238f058 of volume 1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] snapshot_file for this snap is: volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb983e83-47a2-43d8-a433-ad77e3d89c32]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:42 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c 1G" returned: 0 in 0.813s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:42 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:42 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:42 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 Sep 01 02:03:42 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:42 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.400s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:42 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c is being set with open permissions: ugo+rw Sep 01 02:03:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:43 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:43 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:43 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058" returned: 0 in 0.587s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b97f392-b767-40a4-bede-b8ad916b001c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a92a0b-7d20-473e-b1b1-b5c219e95f04]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:43 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c Sep 01 02:03:43 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:43 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.461s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ed876ffd-31cd-4464-8ca1-239e5a10b8ea tempest-VolumesSnapshotListTestJSON-2098279371 None] Create snapshot completed successfully Sep 01 02:03:43 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c" returned: 0 in 0.511s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:43 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 Sep 01 02:03:43 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:44 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058" returned: 0 in 0.690s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:44 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058 Sep 01 02:03:44 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Creating offline snapshot e447b600-153c-48dd-bf6f-60b69f3c90d8 of volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf3408-6563-4368-b189-6abc72c0a01e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:44 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c.3073ec51-2309-4751-8eaf-91c6f238f058" returned: 0 in 0.388s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Lock "cinder-quobyte-3073ec51-2309-4751-8eaf-91c6f238f058" released by "_delete_snapshot" :: held 2.416s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Lock "cinder-quobyte-1b97f392-b767-40a4-bede-b8ad916b001c" released by "delete_snapshot" :: held 2.454s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:44 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:44 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:44 devstack cinder-volume[87404]: WARNING cinder.quota [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-744858442 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-744858442, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:44 devstack cinder-volume[87404]: WARNING cinder.quota [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-744858442 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-744858442, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:44 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] Created reservations ['2f8e908e-45d2-4fed-a53f-4994a4b0cb30', '8d9abf56-8f7e-4df8-b344-5bbdf6c91c05', 'ad0cca32-e21a-48ee-b08b-2be5d74d1a09', '484cc74c-44c3-4be8-b566-05baf8369b7f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-08f97fd7-2fe8-4b94-ba3d-b8f9120cfa92 tempest-GroupSnapshotsV319Test-361412303 None] group_snapshot e5e0bc40-eba7-4d15-9453-970b57586be0: deleted successfully Sep 01 02:03:45 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.639s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:45 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 1G Sep 01 02:03:45 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:46 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 1G" returned: 0 in 0.788s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:46 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 Sep 01 02:03:46 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "cinder-quobyte-1b97f392-b767-40a4-bede-b8ad916b001c" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Lock "cinder-quobyte-1b97f392-b767-40a4-bede-b8ad916b001c" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a1c6d-636a-4c96-a1c4-6d9789d7b9ae]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:46 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c Sep 01 02:03:46 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:46 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8" returned: 0 in 0.590s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:46 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 is being set with open permissions: ugo+rw Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:46 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 Sep 01 02:03:46 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:46 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c" returned: 0 in 0.477s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:46 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c Sep 01 02:03:46 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:47 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cebe0701-8003-418e-be1d-6650c3363cbc tempest-VolumesSnapshotListTestJSON-2098279371 None] Create snapshot completed successfully Sep 01 02:03:47 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1b97f392-b767-40a4-bede-b8ad916b001c" returned: 0 in 0.354s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Lock "cinder-quobyte-1b97f392-b767-40a4-bede-b8ad916b001c" released by "delete_volume" :: held 0.900s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Created reservations ['00d7f36d-0f07-498c-8b51-c0de1e17dab6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:47 devstack cinder-volume[87404]: WARNING cinder.quota [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-744858442 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-744858442, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Created reservations ['9daa2857-9377-4f04-b27d-9bd1aae8a115', 'a7966993-746f-44df-9363-ea61f337a63c', 'eede6b21-8e3b-4b49-8975-4d72b4d9a8e9', '906b627f-4e44-4742-9ddb-9b1b25c0db6c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:47 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:47 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-38d7a53b-d220-42d4-8426-744a0ad6abd3 tempest-ServerActionsTestOtherA-91937418 None] Terminate volume connection completed successfully. Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-38d7a53b-d220-42d4-8426-744a0ad6abd3 tempest-ServerActionsTestOtherA-91937418 None] Deleting attachment c35e6c25-b32f-4bb7-9807-b890ed9d30e8. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:48 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.693s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4b89e835-d018-44f8-a824-39452e89118a tempest-GroupSnapshotsV319Test-361412303 None] Delete group completed successfully. Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "cinder-4e031e57-c328-4651-b193-9c1e88883c2d-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-4e031e57-c328-4651-b193-9c1e88883c2d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "cinder-quobyte-4e031e57-c328-4651-b193-9c1e88883c2d" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-quobyte-4e031e57-c328-4651-b193-9c1e88883c2d" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34add2-1fc3-4402-9b40-290024d0763c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:48 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d Sep 01 02:03:48 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:49 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d" returned: 0 in 1.095s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:49 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d Sep 01 02:03:49 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-e447b600-153c-48dd-bf6f-60b69f3c90d8-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-e447b600-153c-48dd-bf6f-60b69f3c90d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-e447b600-153c-48dd-bf6f-60b69f3c90d8" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-e447b600-153c-48dd-bf6f-60b69f3c90d8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Deleting offline snapshot e447b600-153c-48dd-bf6f-60b69f3c90d8 of volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] snapshot_file for this snap is: volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2318c6f3-0300-4dc9-aee9-b607331cddce]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:50 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 Sep 01 02:03:50 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:50 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e031e57-c328-4651-b193-9c1e88883c2d" returned: 0 in 0.690s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-quobyte-4e031e57-c328-4651-b193-9c1e88883c2d" released by "delete_volume" :: held 1.906s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=78,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=72,cinder:UPDATE=72,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.quota [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Created reservations ['3eca9c61-0d11-43ab-8e01-59f0e9166e72', 'cd1fce0e-0550-4bad-8cc0-985afa1403a5', '1458e9ee-e5ef-445b-991e-ef0ae75c2c72', '4d0c1930-8ed2-4deb-b587-1d241266f353'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:50 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8" returned: 0 in 0.816s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d3602-0596-4431-9622-c2a3c6a0cb11]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:50 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "cinder-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:50 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "cinder-quobyte-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-quobyte-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bca309-d568-4d4a-9460-eee4afa44246]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:51 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:51 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:51 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.350s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG cinder.manager [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Deleted volume successfully. Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-bc6b0fe6-77f4-4ccb-842e-9fe8d4d4b21c req-f1a41581-3fb2-45e0-b994-df364c84dcc4 tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-4e031e57-c328-4651-b193-9c1e88883c2d-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:51 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 Sep 01 02:03:51 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:51 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.892s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:51 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 Sep 01 02:03:51 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:51 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185" returned: 0 in 0.785s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:51 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185 Sep 01 02:03:51 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:52 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185" returned: 0 in 0.344s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-quobyte-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185" released by "delete_volume" :: held 1.209s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Created reservations ['6ff8c335-e822-4808-a625-f4d9072aaaff', '62e4dc23-af0e-4309-b26c-ec0c09d70f91', '7fb5b3d4-3e44-4f0e-b8ae-ba68560cc931', 'e6c9e1e6-a024-4c8c-bef4-6b0e523b6141'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:52 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:03:52 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:52 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8" returned: 0 in 0.894s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:52 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8 Sep 01 02:03:52 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:52 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.354s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Deleted volume successfully. Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a696b738-5aca-4813-8219-db2263b218ac tempest-ServerActionsTestOtherA-91937418 None] Lock "cinder-dbbf2ae9-e9b7-4463-811d-cdcedc4e3185-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:52 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.e447b600-153c-48dd-bf6f-60b69f3c90d8" returned: 0 in 0.351s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-e447b600-153c-48dd-bf6f-60b69f3c90d8" released by "_delete_snapshot" :: held 3.203s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" released by "delete_snapshot" :: held 3.238s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:53 devstack cinder-volume[87404]: WARNING cinder.quota [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Created reservations ['232c755f-b1bd-4faa-801b-9799715d5ce3', '7c005190-b9aa-4ff7-87e7-54ff3c227ea7', 'e7ba409a-7e95-4455-8ba1-462b8d10c5ad', '9f8cf516-8701-49fc-b536-6f57576e5bc1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Delete snapshot completed successfully. Sep 01 02:03:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2c688a16-77cb-42ec-9f63-06773846fa7e tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-e447b600-153c-48dd-bf6f-60b69f3c90d8-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-d5728af8-b448-4622-8c07-618aa1d5aa2c-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-d5728af8-b448-4622-8c07-618aa1d5aa2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-d5728af8-b448-4622-8c07-618aa1d5aa2c" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-d5728af8-b448-4622-8c07-618aa1d5aa2c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Deleting offline snapshot d5728af8-b448-4622-8c07-618aa1d5aa2c of volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] snapshot_file for this snap is: volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13584f8-780c-4fd2-b689-5c5e15cf6f85]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:54 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:54 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:55 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.662s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc2eb9-41fb-4a67-a989-d7ac60f439b3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:55 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:55 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:56 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.894s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:56 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:56 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:56 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.804s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:57 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c Sep 01 02:03:57 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:57 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.d5728af8-b448-4622-8c07-618aa1d5aa2c" returned: 0 in 0.381s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-d5728af8-b448-4622-8c07-618aa1d5aa2c" released by "_delete_snapshot" :: held 2.950s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" released by "delete_snapshot" :: held 3.000s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Created reservations ['2a7692e1-b6e8-4d52-9e0d-5e3a1fb0b5d2', '33949a7f-c67a-489e-a5da-eacd098257c5', 'c73b00ee-9d9d-411d-b252-d3be4f49d9b4', '619e3643-8c23-4e78-b44f-46bc1bb1a4a1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Delete snapshot completed successfully. Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-eb2fc3ee-fc17-487d-9e81-3ae6bfde2f28 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-d5728af8-b448-4622-8c07-618aa1d5aa2c-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-4c72e715-7eb1-413e-9f52-a2c0b14110e4-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-4c72e715-7eb1-413e-9f52-a2c0b14110e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-4c72e715-7eb1-413e-9f52-a2c0b14110e4" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-4c72e715-7eb1-413e-9f52-a2c0b14110e4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Deleting offline snapshot 4c72e715-7eb1-413e-9f52-a2c0b14110e4 of volume 958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] snapshot_file for this snap is: volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fffcb9d-a1a8-4adf-9b4a-e5304b6241e4]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:58 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:58 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:58 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-958349fb-22eb-466e-a178-103f4af71fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:58 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8034a551-ad72-4bda-a0a1-3315b586ea1f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:58 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 Sep 01 02:03:58 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:58 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8" returned: 0 in 0.513s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:58 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:58 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f795efd2-140e-4b46-a2cb-99cde453275a tempest-GroupsTest-1251566555 None] Group tempest-Group1-858077419: creating Sep 01 02:03:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f795efd2-140e-4b46-a2cb-99cde453275a tempest-GroupsTest-1251566555 None] Group tempest-Group1-858077419: created successfully Sep 01 02:03:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f795efd2-140e-4b46-a2cb-99cde453275a tempest-GroupsTest-1251566555 None] Create group completed successfully. Sep 01 02:03:59 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.435s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:59 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4 Sep 01 02:03:59 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:59 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8.4c72e715-7eb1-413e-9f52-a2c0b14110e4" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-4c72e715-7eb1-413e-9f52-a2c0b14110e4" released by "_delete_snapshot" :: held 1.801s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" released by "delete_snapshot" :: held 1.846s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Created reservations ['b73716ed-cad5-4c5b-af01-40240a5c1c51', '39d032a8-8c0f-497a-abf0-dcaa5957da4f', 'd206925a-4b34-4b9d-938d-0a52fffb4646', 'e4aee828-00a0-4d7a-9602-e892fb301f95'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Delete snapshot completed successfully. Sep 01 02:03:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1afbcc02-feb9-43e9-a715-aa250473db79 tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-4c72e715-7eb1-413e-9f52-a2c0b14110e4-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-958349fb-22eb-466e-a178-103f4af71fa8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-958349fb-22eb-466e-a178-103f4af71fa8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0fd9c6-c81e-49e4-b558-2d1b05493c7f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:00 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 Sep 01 02:04:00 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7757c1e8-7d23-4415-847c-1e1083269009 tempest-GroupsTest-1251566555 None] Group tempest-Group2-1564719367: creating Sep 01 02:04:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7757c1e8-7d23-4415-847c-1e1083269009 tempest-GroupsTest-1251566555 None] Group tempest-Group2-1564719367: created successfully Sep 01 02:04:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7757c1e8-7d23-4415-847c-1e1083269009 tempest-GroupsTest-1251566555 None] Create group completed successfully. Sep 01 02:04:00 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8" returned: 0 in 0.483s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:00 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8 Sep 01 02:04:00 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:01 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-958349fb-22eb-466e-a178-103f4af71fa8" returned: 0 in 0.352s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-quobyte-958349fb-22eb-466e-a178-103f4af71fa8" released by "delete_volume" :: held 0.937s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Created reservations ['c5a4b061-8c3a-4dc4-bdcc-562a09577b13', 'f416c28e-9b59-4a2d-976b-85a4a6659adf', '2ed2dd24-0390-4900-b4b8-b695319048da', '0bf78097-58a6-47d5-a331-f23cabf9e8af'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:01 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:01 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:01 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.373s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Deleted volume successfully. Sep 01 02:04:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5e62bcce-8a14-4c4c-867e-f6b9ade43e0d tempest-VolumesSnapshotListTestJSON-2098279371 None] Lock "cinder-958349fb-22eb-466e-a178-103f4af71fa8-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Flow 'volume_create_manager' (d8fe0b8d-a09a-47fb-b03e-eea8ab7d0fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087548c2-300c-4079-9b57-b655228d444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087548c2-300c-4079-9b57-b655228d444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029342801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cab96fcb-170a-450e-8da8-3fdc94a3aa65,host='devstack@QuobyteHD#QuobyteHD',id=dc321fbe-0237-48c3-a453-1c82226ebe99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6642c8479a7d41fca054c7a31a978364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:02Z,use_quota=True,user_id='4099622fd6c44db3ba771e51bb0e42f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee8c5017-3986-41ab-8b80-298cd170d200),volume_type_id=ee8c5017-3986-41ab-8b80-298cd170d200)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644b69ef-b142-4bc2-8710-fa9835cae3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644b69ef-b142-4bc2-8710-fa9835cae3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ea0d46-2cf9-4950-bccb-f5c35ff183e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ea0d46-2cf9-4950-bccb-f5c35ff183e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc321fbe-0237-48c3-a453-1c82226ebe99', 'volume_name': 'volume-dc321fbe-0237-48c3-a453-1c82226ebe99', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7b62ed-4825-4dda-877a-fa134e4eae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7b62ed-4825-4dda-877a-fa134e4eae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315545ce-a390-4534-9421-16d9c05aa918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:02 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Volume dc321fbe-0237-48c3-a453-1c82226ebe99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc321fbe-0237-48c3-a453-1c82226ebe99', 'volume_size': 1} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cab96fcb-170a-450e-8da8-3fdc94a3aa65,created_at=2026-09-01T00:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029342801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cab96fcb-170a-450e-8da8-3fdc94a3aa65,host='devstack@QuobyteHD#QuobyteHD',id=dc321fbe-0237-48c3-a453-1c82226ebe99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6642c8479a7d41fca054c7a31a978364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:02Z,use_quota=True,user_id='4099622fd6c44db3ba771e51bb0e42f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee8c5017-3986-41ab-8b80-298cd170d200),volume_type_id=ee8c5017-3986-41ab-8b80-298cd170d200)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Creating volume dc321fbe-0237-48c3-a453-1c82226ebe99 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:02 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:04:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:02 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 1073741824 Sep 01 02:04:02 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:03 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 1073741824" returned: 0 in 0.523s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:03 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 Sep 01 02:04:03 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:03 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99" returned: 0 in 0.472s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315545ce-a390-4534-9421-16d9c05aa918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc321fbe-0237-48c3-a453-1c82226ebe99', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1061835-de1b-4eaa-b9f2-6bf18c1127c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Volume volume-dc321fbe-0237-48c3-a453-1c82226ebe99 (dc321fbe-0237-48c3-a453-1c82226ebe99): created successfully Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1061835-de1b-4eaa-b9f2-6bf18c1127c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Flow 'volume_create_manager' (d8fe0b8d-a09a-47fb-b03e-eea8ab7d0fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ddcefab6-e12b-49f4-a42f-f5cb3ade10e2 tempest-GroupsTest-1251566555 None] Created volume successfully. Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Acquiring lock "cinder-quobyte-dc321fbe-0237-48c3-a453-1c82226ebe99" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Lock "cinder-quobyte-dc321fbe-0237-48c3-a453-1c82226ebe99" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce3ecc-ff7e-4e5c-b640-95c0f1322871]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:06 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 Sep 01 02:04:06 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:06 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99" returned: 0 in 0.467s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:06 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99 Sep 01 02:04:06 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:06 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc321fbe-0237-48c3-a453-1c82226ebe99" returned: 0 in 0.278s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Lock "cinder-quobyte-dc321fbe-0237-48c3-a453-1c82226ebe99" released by "delete_volume" :: held 0.809s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Created reservations ['4cb025a1-3fbf-46ad-a461-ac88bde18186'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:07 devstack cinder-volume[87404]: WARNING cinder.quota [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1557118056 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1557118056, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:07 devstack cinder-volume[87404]: WARNING cinder.quota [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1557118056 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1557118056, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Created reservations ['7fea16df-c8d5-4211-8093-f3bee4769388', 'd9f5c34f-d5ea-47ed-91b7-3c9576218d9e', 'd82e1f46-2494-4802-9387-dce664fba1c6', '88389ada-d652-4cfd-a332-d6d17c61a263'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:07 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:07 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Created reservations ['5e57b46c-4146-4e34-8547-92c30dc742c0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:07 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.364s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cce98c53-7419-40a1-b552-955a316fd39c tempest-GroupsTest-1251566555 None] Delete group completed successfully. Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:07 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:07 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:07 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:07 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-33298c84-2a9c-44ee-8649-c90a9e03b8a2 tempest-GroupsTest-1251566555 None] Delete group completed successfully. Sep 01 02:04:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6133707a-3240-4480-a808-2ab7a5a6eb33 tempest-GroupsTest-1251566555 None] Group tempest-GroupsTest-Group-1027850915: creating Sep 01 02:04:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6133707a-3240-4480-a808-2ab7a5a6eb33 tempest-GroupsTest-1251566555 None] Group tempest-GroupsTest-Group-1027850915: created successfully Sep 01 02:04:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6133707a-3240-4480-a808-2ab7a5a6eb33 tempest-GroupsTest-1251566555 None] Create group completed successfully. Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Flow 'volume_create_manager' (d46ab61d-4fab-4fc8-926a-150a8a2c3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bd37b0-2478-42ed-8077-86ef56e653a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bd37b0-2478-42ed-8077-86ef56e653a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284886408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc71713-6ae3-4501-93a0-3d5089a50c1a,host='devstack@QuobyteHD#QuobyteHD',id=212ab30c-cffd-4eda-b0e7-6bbe14b0c623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6642c8479a7d41fca054c7a31a978364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:11Z,use_quota=True,user_id='4099622fd6c44db3ba771e51bb0e42f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdeca09-b70f-4fb7-bc61-3fb5b1bda950),volume_type_id=1fdeca09-b70f-4fb7-bc61-3fb5b1bda950)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c418474-8a4c-4b2c-a00e-88c0acbbe10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c418474-8a4c-4b2c-a00e-88c0acbbe10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501ab25-1fde-4c94-8a89-a44cc2496b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501ab25-1fde-4c94-8a89-a44cc2496b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212ab30c-cffd-4eda-b0e7-6bbe14b0c623', 'volume_name': 'volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bb7b10-ad87-4a69-8cbc-ab41e72d9a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bb7b10-ad87-4a69-8cbc-ab41e72d9a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0691e3-25e9-4b3c-8c4f-4be95900e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Volume 212ab30c-cffd-4eda-b0e7-6bbe14b0c623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623', 'volume_size': 1} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ffc71713-6ae3-4501-93a0-3d5089a50c1a,created_at=2026-09-01T00:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284886408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc71713-6ae3-4501-93a0-3d5089a50c1a,host='devstack@QuobyteHD#QuobyteHD',id=212ab30c-cffd-4eda-b0e7-6bbe14b0c623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6642c8479a7d41fca054c7a31a978364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:11Z,use_quota=True,user_id='4099622fd6c44db3ba771e51bb0e42f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdeca09-b70f-4fb7-bc61-3fb5b1bda950),volume_type_id=1fdeca09-b70f-4fb7-bc61-3fb5b1bda950)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Creating volume 212ab30c-cffd-4eda-b0e7-6bbe14b0c623 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:11 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:04:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:11 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 1073741824 Sep 01 02:04:11 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:11 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 1073741824" returned: 0 in 0.491s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:12 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 Sep 01 02:04:12 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623" returned: 0 in 0.288s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0691e3-25e9-4b3c-8c4f-4be95900e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c8061a-931c-4c72-b9e2-8eb2def651ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:12 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Volume volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 (212ab30c-cffd-4eda-b0e7-6bbe14b0c623): created successfully Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c8061a-931c-4c72-b9e2-8eb2def651ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Flow 'volume_create_manager' (d46ab61d-4fab-4fc8-926a-150a8a2c3d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-27611c78-9788-4265-ae8b-159f5ee5c1b3 tempest-GroupsTest-1251566555 None] Created volume successfully. Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Flow 'volume_create_manager' (45aef787-e264-4d62-ad2d-dc3bc8f9d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6f501e-7d41-4d50-b2a4-b44162944c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6f501e-7d41-4d50-b2a4-b44162944c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-41847129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc71713-6ae3-4501-93a0-3d5089a50c1a,host='devstack@QuobyteHD#QuobyteHD',id=fe475b9c-ff9d-4bba-b965-4de3a23b5c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6642c8479a7d41fca054c7a31a978364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:13Z,use_quota=True,user_id='4099622fd6c44db3ba771e51bb0e42f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdeca09-b70f-4fb7-bc61-3fb5b1bda950),volume_type_id=1fdeca09-b70f-4fb7-bc61-3fb5b1bda950)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6416ce-10e1-406c-8321-83320e2d52fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6416ce-10e1-406c-8321-83320e2d52fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f55d95f-415e-4469-80e2-b3cf93eecb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f55d95f-415e-4469-80e2-b3cf93eecb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe475b9c-ff9d-4bba-b965-4de3a23b5c4a', 'volume_name': 'volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39d98e6-a5d5-46a2-8d42-40080b2018c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39d98e6-a5d5-46a2-8d42-40080b2018c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3cbc28-0e50-4fd6-ab16-3e90b38454c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:13 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Volume fe475b9c-ff9d-4bba-b965-4de3a23b5c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a', 'volume_size': 1} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ffc71713-6ae3-4501-93a0-3d5089a50c1a,created_at=2026-09-01T00:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-41847129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc71713-6ae3-4501-93a0-3d5089a50c1a,host='devstack@QuobyteHD#QuobyteHD',id=fe475b9c-ff9d-4bba-b965-4de3a23b5c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6642c8479a7d41fca054c7a31a978364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:13Z,use_quota=True,user_id='4099622fd6c44db3ba771e51bb0e42f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdeca09-b70f-4fb7-bc61-3fb5b1bda950),volume_type_id=1fdeca09-b70f-4fb7-bc61-3fb5b1bda950)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Creating volume fe475b9c-ff9d-4bba-b965-4de3a23b5c4a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:13 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:04:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:13 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a 1073741824 Sep 01 02:04:13 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:14 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a 1073741824" returned: 0 in 0.576s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:14 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a Sep 01 02:04:14 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:14 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a" returned: 0 in 0.305s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3cbc28-0e50-4fd6-ab16-3e90b38454c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b708a55b-65b7-410b-a43a-d063c9f8d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:14 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Volume volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a (fe475b9c-ff9d-4bba-b965-4de3a23b5c4a): created successfully Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b708a55b-65b7-410b-a43a-d063c9f8d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Flow 'volume_create_manager' (45aef787-e264-4d62-ad2d-dc3bc8f9d446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:14 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-725f3a92-74f7-4a4a-bbe1-57479aab1ae7 tempest-GroupsTest-1251566555 None] Created volume successfully. Sep 01 02:04:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-18d0b920-bf9c-486e-9848-ff8077e42c43 tempest-GroupsTest-1251566555 None] Update group completed successfully. Sep 01 02:04:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c3aa7789-1c7e-4f8f-8fb4-55d4df613fe6 tempest-GroupsTest-1251566555 None] Update group completed successfully. Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Flow 'volume_create_manager' (d9323408-2dfa-4ae7-b4ab-809f57aaff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bfecda-a72c-4ac4-a897-d5260b3edadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bfecda-a72c-4ac4-a897-d5260b3edadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1716698295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cde8a8e25c4a1ea0c0d91e2725675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:20Z,use_quota=True,user_id='e20527e6fa7f4ae0aaca0631af09a1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8260dcb-d587-47f3-a839-64254a446dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8260dcb-d587-47f3-a839-64254a446dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c05714f-c8de-4801-8ef1-90e07426fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c05714f-c8de-4801-8ef1-90e07426fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9', 'volume_name': 'volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce8d80-ac44-47e4-842c-27df92103b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce8d80-ac44-47e4-842c-27df92103b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9526d-3a74-432c-89ad-f0e6e583279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Volume cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9', 'volume_size': 1} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1716698295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cde8a8e25c4a1ea0c0d91e2725675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:20Z,use_quota=True,user_id='e20527e6fa7f4ae0aaca0631af09a1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Creating volume cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:19 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 1073741824 Sep 01 02:04:19 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Acquiring lock "cinder-quobyte-212ab30c-cffd-4eda-b0e7-6bbe14b0c623" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Lock "cinder-quobyte-212ab30c-cffd-4eda-b0e7-6bbe14b0c623" acquired by "delete_volume" :: waited 0.046s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8201917d-9984-440f-9004-0b2fa39a9d4c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 Sep 01 02:04:20 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623" returned: 0 in 0.552s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 1073741824" returned: 0 in 0.730s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623 Sep 01 02:04:20 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 Sep 01 02:04:20 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-212ab30c-cffd-4eda-b0e7-6bbe14b0c623" returned: 0 in 0.480s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9" returned: 0 in 0.407s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Lock "cinder-quobyte-212ab30c-cffd-4eda-b0e7-6bbe14b0c623" released by "delete_volume" :: held 1.095s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Acquiring lock "cinder-quobyte-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9526d-3a74-432c-89ad-f0e6e583279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5981e307-1c0c-4907-a7fa-a3594a7d1bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Lock "cinder-quobyte-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a" acquired by "delete_volume" :: waited 0.056s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Volume volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 (cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9): created successfully Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5981e307-1c0c-4907-a7fa-a3594a7d1bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Flow 'volume_create_manager' (d9323408-2dfa-4ae7-b4ab-809f57aaff65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa0811-df11-4921-bab6-05175421f4af]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-58409b70-d398-4d20-ac98-328f9a05112a tempest-AttachVolumeTestJSON-228910636 None] Created volume successfully. Sep 01 02:04:21 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a Sep 01 02:04:21 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a" returned: 0 in 0.465s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a Sep 01 02:04:21 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Lock "cinder-quobyte-fe475b9c-ff9d-4bba-b965-4de3a23b5c4a" released by "delete_volume" :: held 0.895s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Created reservations ['cfda8aac-facc-42e4-92f5-962f7625c36a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:22 devstack cinder-volume[87404]: WARNING cinder.quota [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2139283895 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2139283895, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:22 devstack cinder-volume[87404]: WARNING cinder.quota [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2139283895 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2139283895, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Created reservations ['07816410-5832-4510-af23-48ec15d38f5b', 'fd47e6d1-9b32-4073-86e3-144807210e2d', 'd91608d4-3e45-496b-89f1-ed8f0a53a82f', 'aab3dd95-f681-4de4-8ad3-667e3b752932'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Created reservations ['afe39d3b-ea40-4ad8-9a6f-11667be21b07', 'af270232-1147-4517-876a-15fe50472cf3', '06ee9715-ea68-4ce3-a36c-7207f7703d87', '30ee13cb-2882-4419-9498-2fa7e5f4e49f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:22 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:22 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:23 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.529s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:23 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-26965df2-4b2b-407e-b8ff-96c7e33c14b9 tempest-GroupsTest-1251566555 None] Delete group completed successfully. Sep 01 02:04:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-f5300710-c57c-4e6a-9e2d-16a194175571 req-7b53a84f-b162-4f06-92e5-0e527d768767 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-f5300710-c57c-4e6a-9e2d-16a194175571 req-7b53a84f-b162-4f06-92e5-0e527d768767 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-f5300710-c57c-4e6a-9e2d-16a194175571 req-7b53a84f-b162-4f06-92e5-0e527d768767 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-f5300710-c57c-4e6a-9e2d-16a194175571 req-7b53a84f-b162-4f06-92e5-0e527d768767 tempest-AttachVolumeTestJSON-228910636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f6440a8-9c18-431b-a9e8-b2c2aa51475d', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-f5300710-c57c-4e6a-9e2d-16a194175571 req-7b53a84f-b162-4f06-92e5-0e527d768767 tempest-AttachVolumeTestJSON-228910636 None] attachment_update completed successfully. Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Flow 'volume_create_manager' (2b4c0fff-6153-4aec-8b5c-9a9ee46e55b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab46649-8c8b-466a-a24d-db4cd578b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab46649-8c8b-466a-a24d-db4cd578b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1250252081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9e19fd-5aa5-4097-aaf6-4d62260a14a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cde8a8e25c4a1ea0c0d91e2725675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:26Z,use_quota=True,user_id='e20527e6fa7f4ae0aaca0631af09a1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da31176-5150-449c-8100-084c919f27ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da31176-5150-449c-8100-084c919f27ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211c3950-4d53-4807-bd2e-47c33ebcd934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211c3950-4d53-4807-bd2e-47c33ebcd934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9e19fd-5aa5-4097-aaf6-4d62260a14a8', 'volume_name': 'volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d336051-ce9e-41a7-bd78-70b6ed78bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d336051-ce9e-41a7-bd78-70b6ed78bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b50188-87e3-42ac-bf4e-10521d41ef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Volume 5a9e19fd-5aa5-4097-aaf6-4d62260a14a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8', 'volume_size': 1} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1250252081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9e19fd-5aa5-4097-aaf6-4d62260a14a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08cde8a8e25c4a1ea0c0d91e2725675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:26Z,use_quota=True,user_id='e20527e6fa7f4ae0aaca0631af09a1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Creating volume 5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:26 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:04:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:26 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 1073741824 Sep 01 02:04:26 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:27 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 1073741824" returned: 0 in 0.576s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:27 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 Sep 01 02:04:27 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:27 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8" returned: 0 in 0.324s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b50188-87e3-42ac-bf4e-10521d41ef05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0467b41a-fcdd-4216-b4dc-f5a9709de93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:27 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Volume volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 (5a9e19fd-5aa5-4097-aaf6-4d62260a14a8): created successfully Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0467b41a-fcdd-4216-b4dc-f5a9709de93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Flow 'volume_create_manager' (2b4c0fff-6153-4aec-8b5c-9a9ee46e55b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-822202b6-51f1-4cde-b172-2d9c14ade9a5 tempest-AttachVolumeTestJSON-228910636 None] Created volume successfully. Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:28 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:28 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:29 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.565s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:04:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:04:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-c58ee715-aeb7-44f4-8700-53dc0a8ca39b req-bdc12131-43f6-49cc-bd26-067712d2cbfa tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-c58ee715-aeb7-44f4-8700-53dc0a8ca39b req-bdc12131-43f6-49cc-bd26-067712d2cbfa tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-c58ee715-aeb7-44f4-8700-53dc0a8ca39b req-bdc12131-43f6-49cc-bd26-067712d2cbfa tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-c58ee715-aeb7-44f4-8700-53dc0a8ca39b req-bdc12131-43f6-49cc-bd26-067712d2cbfa tempest-AttachVolumeTestJSON-228910636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31f10d49-faf6-4382-8925-c99ada288a85', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-c58ee715-aeb7-44f4-8700-53dc0a8ca39b req-bdc12131-43f6-49cc-bd26-067712d2cbfa tempest-AttachVolumeTestJSON-228910636 None] attachment_update completed successfully. Sep 01 02:04:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-8a706834-06ee-42a0-acfc-90c4377508d7 req-eb509d99-c7d2-4d56-a0e2-410a8630eab3 tempest-AttachVolumeTestJSON-228910636 None] Terminate volume connection completed successfully. Sep 01 02:04:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-8a706834-06ee-42a0-acfc-90c4377508d7 req-eb509d99-c7d2-4d56-a0e2-410a8630eab3 tempest-AttachVolumeTestJSON-228910636 None] Deleting attachment 5f6440a8-9c18-431b-a9e8-b2c2aa51475d. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:04:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-f6971c93-e1dd-4304-9482-4618ec04f696 req-b89751b3-9729-4a30-a8bb-501ed85aae7d tempest-AttachVolumeTestJSON-228910636 None] Terminate volume connection completed successfully. Sep 01 02:04:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-f6971c93-e1dd-4304-9482-4618ec04f696 req-b89751b3-9729-4a30-a8bb-501ed85aae7d tempest-AttachVolumeTestJSON-228910636 None] Deleting attachment 31f10d49-faf6-4382-8925-c99ada288a85. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:04:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-76def95d-347e-4ef4-b941-f6007dfc82fa tempest-GroupsV320Test-1720058453 None] Group tempest-GroupsV320Test-Group-1398757714: creating Sep 01 02:04:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-76def95d-347e-4ef4-b941-f6007dfc82fa tempest-GroupsV320Test-1720058453 None] Group tempest-GroupsV320Test-Group-1398757714: created successfully Sep 01 02:04:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-76def95d-347e-4ef4-b941-f6007dfc82fa tempest-GroupsV320Test-1720058453 None] Create group completed successfully. Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Flow 'volume_create_manager' (fdd3416c-49c0-4fb3-b16f-c5a9b1b3df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab07c199-1b3e-431d-8166-ad4fa02dffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab07c199-1b3e-431d-8166-ad4fa02dffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1541200099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00a9e96-2662-418c-9919-cbfc3d11dd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed968d48e5e54af08a0f396c2f9c3fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:39Z,use_quota=True,user_id='0cd582a9ef6d4c1daf94103e9639d798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f432764-efe7-4cd9-add3-60841e45f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f432764-efe7-4cd9-add3-60841e45f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a5a996-ff47-4953-abdf-62f9b246f468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a5a996-ff47-4953-abdf-62f9b246f468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd00a9e96-2662-418c-9919-cbfc3d11dd98', 'volume_name': 'volume-d00a9e96-2662-418c-9919-cbfc3d11dd98', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0ed5b5-1918-4cd3-8a1b-9446c469a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0ed5b5-1918-4cd3-8a1b-9446c469a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0373545-02d5-4d3f-b24e-03bac84f5833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:40 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Volume d00a9e96-2662-418c-9919-cbfc3d11dd98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d00a9e96-2662-418c-9919-cbfc3d11dd98', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Trying to clone d00a9e96-2662-418c-9919-cbfc3d11dd98 from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:04:40 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:04:40 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08a424a-0e5f-4acb-afd9-39c55b849e17]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD Sep 01 02:04:41 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Created reservations ['a53e0c1b-e9f0-4acc-a34b-c73c251e74b5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD" returned: 0 in 0.624s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 is fetched for user 0cd582a9ef6d4c1daf94103e9639d798. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:04:41 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:41 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd194a-8628-4fdb-818a-9869d08c3015]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD Sep 01 02:04:41 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:41 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-736aa74c-c01f-45cb-80dd-5eca07098a1d tempest-GroupsV320Test-1720058453 None] Delete group completed successfully. Sep 01 02:04:42 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1541200099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00a9e96-2662-418c-9919-cbfc3d11dd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed968d48e5e54af08a0f396c2f9c3fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:39Z,use_quota=True,user_id='0cd582a9ef6d4c1daf94103e9639d798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Creating volume d00a9e96-2662-418c-9919-cbfc3d11dd98 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:42 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 1073741824 Sep 01 02:04:42 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 1073741824" returned: 0 in 0.632s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 Sep 01 02:04:42 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98" returned: 0 in 0.415s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Attempting download of d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume d00a9e96-2662-418c-9919-cbfc3d11dd98. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eda8e4e-af49-4a39-9760-bdd879651901]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "cinder-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:43 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71 Sep 01 02:04:43 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "cinder-quobyte-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-quobyte-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8" acquired by "delete_volume" :: waited 0.074s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[275b669c-e7d4-4bb3-82bf-738e56a47c50]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71" returned: 0 in 0.766s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 Sep 01 02:04:44 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71 Sep 01 02:04:44 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8" returned: 0 in 0.899s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8 Sep 01 02:04:44 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71" returned: 1 in 0.738s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_f8di6l71' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0516f3f-890e-4dca-b2a5-c8e59229d39b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD Sep 01 02:04:45 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8" returned: 0 in 0.556s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-quobyte-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8" released by "delete_volume" :: held 1.576s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Created reservations ['bb39fd0e-062d-485d-a995-0878df7bd85b', '75661692-d5d6-49dc-b633-3d2e05f0cd2f', '6d92e995-2c13-4e18-9232-64d5778ec458', 'db4fb813-fc6e-46b7-b8c5-5a613eca56c8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:45 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD" returned: 0 in 0.546s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 was qcow2, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 Sep 01 02:04:45 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:45 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "cinder-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:46 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.691s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Deleted volume successfully. Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "cinder-quobyte-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc04fc46-030f-43eb-b458-81c7adf246de tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-5a9e19fd-5aa5-4097-aaf6-4d62260a14a8-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-quobyte-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9" acquired by "delete_volume" :: waited 0.057s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83f555-188c-498c-9154-d9660ef052f3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 Sep 01 02:04:46 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:47 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9" returned: 0 in 0.629s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9 Sep 01 02:04:47 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:47 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9" returned: 0 in 0.417s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-quobyte-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9" released by "delete_volume" :: held 1.127s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Created reservations ['62008866-86e1-4957-8e44-dca232564e83', '4c4f1f6b-a826-4e67-9478-0fb740722efe', 'f085bca6-3456-4783-a633-ebbafcffe0ea', '978e72dc-d48c-44c3-8e19-d8fcd6377078'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:47 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.529s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Deleted volume successfully. Sep 01 02:04:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9d937384-1df1-4f07-a73c-f45c29812167 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-cb1bb50b-1dd5-4ca9-aaef-f13665a7b3a9-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "cinder-73feeff7-7c44-4918-b54c-a30ca8ce0119-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:49 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98" returned: 0 in 3.636s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_jx_ahke9devstack@QuobyteHD, size 112.00 MB, duration 3.65 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:04:49 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Converted 112.00 MB image at 30.69 MB/s Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-73feeff7-7c44-4918-b54c-a30ca8ce0119-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:49 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 1G Sep 01 02:04:49 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "cinder-quobyte-73feeff7-7c44-4918-b54c-a30ca8ce0119" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-quobyte-73feeff7-7c44-4918-b54c-a30ca8ce0119" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[444a2da6-5c6e-4744-a849-0308108fd1b5]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 Sep 01 02:04:49 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 1G" returned: 0 in 0.765s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Downloaded image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume d00a9e96-2662-418c-9919-cbfc3d11dd98 successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 for user 0cd582a9ef6d4c1daf94103e9639d798 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Marking volume d00a9e96-2662-418c-9919-cbfc3d11dd98 as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Copying metadata from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 to d00a9e96-2662-418c-9919-cbfc3d11dd98. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:04:49 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Creating volume glance metadata for volume d00a9e96-2662-418c-9919-cbfc3d11dd98 backed by image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:04:50 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0373545-02d5-4d3f-b24e-03bac84f5833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00a9e96-2662-418c-9919-cbfc3d11dd98', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c57433-a0e2-4aef-925c-e0ac8185a441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119" returned: 0 in 0.922s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Volume volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 (d00a9e96-2662-418c-9919-cbfc3d11dd98): created successfully Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c57433-a0e2-4aef-925c-e0ac8185a441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:50 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119 Sep 01 02:04:50 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Flow 'volume_create_manager' (fdd3416c-49c0-4fb3-b16f-c5a9b1b3df17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:50 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8064e32d-5772-4527-8b9f-db255f0d2a61 tempest-TestShelveInstance-1733731671 None] Created volume successfully. Sep 01 02:04:50 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-73feeff7-7c44-4918-b54c-a30ca8ce0119" returned: 0 in 0.466s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-quobyte-73feeff7-7c44-4918-b54c-a30ca8ce0119" released by "delete_volume" :: held 1.482s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=122,cinder:INSERT=34,cinder:UPDATE=115,cinder:DELETE=4 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=109,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=7 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Created reservations ['c5e24cee-1b67-4071-8a6f-82fa1ec576d1', '60a180a9-427f-4ed7-8637-154f6709caf9', '9bd98484-82ea-4836-a5b9-97b5c7420591', '48e365a4-c36f-444a-b518-fd1c10a4ead9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:04:51 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.336s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:51 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Deleted volume successfully. Sep 01 02:04:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5cdfe311-e1a1-4bc8-b3cd-a6132573da34 tempest-AttachVolumeTestJSON-228910636 None] Lock "cinder-73feeff7-7c44-4918-b54c-a30ca8ce0119-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-4a284324-6fce-4bd9-a9bf-91f9ba088b99 req-8d9f8bcb-04d6-4152-8e40-1c3c1937e22c tempest-TestShelveInstance-1733731671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-4a284324-6fce-4bd9-a9bf-91f9ba088b99 req-8d9f8bcb-04d6-4152-8e40-1c3c1937e22c tempest-TestShelveInstance-1733731671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-4a284324-6fce-4bd9-a9bf-91f9ba088b99 req-8d9f8bcb-04d6-4152-8e40-1c3c1937e22c tempest-TestShelveInstance-1733731671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-4a284324-6fce-4bd9-a9bf-91f9ba088b99 req-8d9f8bcb-04d6-4152-8e40-1c3c1937e22c tempest-TestShelveInstance-1733731671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-d00a9e96-2662-418c-9919-cbfc3d11dd98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d0c5076-c221-4fc5-ad57-d340939ae262', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-4a284324-6fce-4bd9-a9bf-91f9ba088b99 req-8d9f8bcb-04d6-4152-8e40-1c3c1937e22c tempest-TestShelveInstance-1733731671 None] attachment_update completed successfully. Sep 01 02:05:05 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:05 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:INSERT=1,cinder:UPDATE=8,cinder:SELECT=7,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Flow 'volume_create_manager' (10c20a53-cdae-410c-b064-91578fb84b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a63b1cb-270f-40ab-9510-506e5fdb5135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a63b1cb-270f-40ab-9510-506e5fdb5135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1258057464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c15ec4-8f74-48ed-86b0-2601695b7e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea626254c03c4b799163e2f65fdbf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:14Z,use_quota=True,user_id='af5498ac35e04520b8537e825c2559dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9838ba12-332d-43ea-8ea1-87b567f5ad7a),volume_type_id=9838ba12-332d-43ea-8ea1-87b567f5ad7a)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cc117b-01ab-4dd3-bee6-4d4424e3e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cc117b-01ab-4dd3-bee6-4d4424e3e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3507dd8e-a0d9-4f61-a9cc-b4884d2aaabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3507dd8e-a0d9-4f61-a9cc-b4884d2aaabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c15ec4-8f74-48ed-86b0-2601695b7e4c', 'volume_name': 'volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0567008d-6305-482a-a233-33caf79830ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0567008d-6305-482a-a233-33caf79830ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6737cfc-642e-4e05-9708-6c227c5200af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:14 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Volume f3c15ec4-8f74-48ed-86b0-2601695b7e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c', 'volume_size': 1} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1258057464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c15ec4-8f74-48ed-86b0-2601695b7e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea626254c03c4b799163e2f65fdbf6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:14Z,use_quota=True,user_id='af5498ac35e04520b8537e825c2559dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9838ba12-332d-43ea-8ea1-87b567f5ad7a),volume_type_id=9838ba12-332d-43ea-8ea1-87b567f5ad7a)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Creating volume f3c15ec4-8f74-48ed-86b0-2601695b7e4c {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:14 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:14 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c 1073741824 Sep 01 02:05:14 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:14 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c 1073741824" returned: 0 in 0.561s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:14 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c Sep 01 02:05:14 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:15 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c" returned: 0 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6737cfc-642e-4e05-9708-6c227c5200af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c27df40-ca0b-49c0-ad2f-fc8ae2e07989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Volume volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c (f3c15ec4-8f74-48ed-86b0-2601695b7e4c): created successfully Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c27df40-ca0b-49c0-ad2f-fc8ae2e07989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Flow 'volume_create_manager' (10c20a53-cdae-410c-b064-91578fb84b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:15 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b5b63fbe-99b5-4755-9084-5f0be0375cdb tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Created volume successfully. Sep 01 02:05:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:16 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:05:16 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:17 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.408s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a39662df-b18a-43a8-8b66-7ca86e5ff50a tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Retype volume completed successfully. Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Flow 'volume_create_manager' (1ad05404-0863-4893-9d98-6456208874b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aced72-be33-42ac-901c-09b06d12dfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aced72-be33-42ac-901c-09b06d12dfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1473401757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5b8db4-b033-4bf1-a69b-c27568d79623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee638413c7543f29997982e747e07a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:17Z,use_quota=True,user_id='4c3c66cba9264926967d02e21925292f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c74c4-beee-47eb-bf65-1f733f230449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c74c4-beee-47eb-bf65-1f733f230449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dea5331-33c9-4d0c-ba47-897145066df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dea5331-33c9-4d0c-ba47-897145066df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5b8db4-b033-4bf1-a69b-c27568d79623', 'volume_name': 'volume-dc5b8db4-b033-4bf1-a69b-c27568d79623', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954b4aa-31e3-42d9-8dd2-0136440ecc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954b4aa-31e3-42d9-8dd2-0136440ecc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb352f2-5c82-4c0b-b644-dd31f2a26040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Volume dc5b8db4-b033-4bf1-a69b-c27568d79623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5b8db4-b033-4bf1-a69b-c27568d79623', 'volume_size': 1} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1473401757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5b8db4-b033-4bf1-a69b-c27568d79623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee638413c7543f29997982e747e07a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:17Z,use_quota=True,user_id='4c3c66cba9264926967d02e21925292f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Creating volume dc5b8db4-b033-4bf1-a69b-c27568d79623 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:17 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:17 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 1073741824 Sep 01 02:05:17 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Acquiring lock "cinder-f3c15ec4-8f74-48ed-86b0-2601695b7e4c-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "cinder-f3c15ec4-8f74-48ed-86b0-2601695b7e4c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Acquiring lock "cinder-quobyte-f3c15ec4-8f74-48ed-86b0-2601695b7e4c" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "cinder-quobyte-f3c15ec4-8f74-48ed-86b0-2601695b7e4c" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87a300-088e-495a-b8cf-01f85d5ef5cf]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 1073741824" returned: 0 in 0.788s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c Sep 01 02:05:18 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 Sep 01 02:05:18 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:18 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623" returned: 0 in 0.348s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:18 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c" returned: 0 in 0.590s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb352f2-5c82-4c0b-b644-dd31f2a26040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5b8db4-b033-4bf1-a69b-c27568d79623', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70f5407-b901-409b-8e9e-17949a926369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:18 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c Sep 01 02:05:18 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Volume volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 (dc5b8db4-b033-4bf1-a69b-c27568d79623): created successfully Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70f5407-b901-409b-8e9e-17949a926369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Flow 'volume_create_manager' (1ad05404-0863-4893-9d98-6456208874b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6f9fd540-c701-41a5-85e3-2d185e330df7 tempest-AttachVolumeShelveTestJSON-496923693 None] Created volume successfully. Sep 01 02:05:19 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3c15ec4-8f74-48ed-86b0-2601695b7e4c" returned: 0 in 0.461s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "cinder-quobyte-f3c15ec4-8f74-48ed-86b0-2601695b7e4c" released by "delete_volume" :: held 1.124s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:19 devstack cinder-volume[87404]: WARNING cinder.quota [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:19 devstack cinder-volume[87404]: WARNING cinder.quota [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Created reservations ['c95571bb-4868-48be-b473-19defb109b59', 'bec2cb06-b288-4af5-b537-9bdcaf5d92ca', '54a6039a-943c-41cc-b61c-fb2a2354fe31', '2a4bd1b3-86be-44ec-9c98-786aa0a6ba8b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:19 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:05:19 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:19 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:19 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Deleted volume successfully. Sep 01 02:05:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3213038b-bf6d-49f0-80f0-af35f43e1ab2 tempest-VolumeRetypeWithoutMigrationTest-878127881 None] Lock "cinder-f3c15ec4-8f74-48ed-86b0-2601695b7e4c-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:28 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:05:28 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:29 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.517s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:29 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=18,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-624bf60f-a727-4f92-b566-7a6808803156 req-808f6ea3-8f85-4937-86fe-621b7f250f1a tempest-AttachVolumeShelveTestJSON-496923693 None] No connector for attachment 8127fce1-521b-4965-bf4d-a36c53a1bb5d; skipping storage backend terminate_connection call. {{(pid=87404) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 02:05:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-624bf60f-a727-4f92-b566-7a6808803156 req-808f6ea3-8f85-4937-86fe-621b7f250f1a tempest-AttachVolumeShelveTestJSON-496923693 None] Deleting attachment 8127fce1-521b-4965-bf4d-a36c53a1bb5d. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-6e33dd20-303f-456c-ae2f-94b7c7f185e7 req-e042899e-a549-49b7-82b2-2581f7b142a1 tempest-TestShelveInstance-1733731671 None] Terminate volume connection completed successfully. Sep 01 02:05:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-6e33dd20-303f-456c-ae2f-94b7c7f185e7 req-e042899e-a549-49b7-82b2-2581f7b142a1 tempest-TestShelveInstance-1733731671 None] Deleting attachment 2d0c5076-c221-4fc5-ad57-d340939ae262. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-07544606-012e-468f-960c-86ebec79a19e req-f86ce587-50ab-4c8d-87d7-99cadfccc1d7 tempest-TestShelveInstance-1733731671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-07544606-012e-468f-960c-86ebec79a19e req-f86ce587-50ab-4c8d-87d7-99cadfccc1d7 tempest-TestShelveInstance-1733731671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-07544606-012e-468f-960c-86ebec79a19e req-f86ce587-50ab-4c8d-87d7-99cadfccc1d7 tempest-TestShelveInstance-1733731671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-07544606-012e-468f-960c-86ebec79a19e req-f86ce587-50ab-4c8d-87d7-99cadfccc1d7 tempest-TestShelveInstance-1733731671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-d00a9e96-2662-418c-9919-cbfc3d11dd98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cd4dc5e-5305-480b-8dec-929d269e298f', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-07544606-012e-468f-960c-86ebec79a19e req-f86ce587-50ab-4c8d-87d7-99cadfccc1d7 tempest-TestShelveInstance-1733731671 None] attachment_update completed successfully. Sep 01 02:05:53 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:53 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Flow 'volume_create_manager' (7fe7c383-2676-448e-afc3-45062e6cb4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682452c3-c703-4c0e-a69c-30214fbc5828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682452c3-c703-4c0e-a69c-30214fbc5828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-353984312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeaa770-81f8-4a90-8f23-45c3aa6b95b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8196cddee8749e0874aefbff29e094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:54Z,use_quota=True,user_id='f4a323af8ba34e3a9a191f7312a7528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8e2f75-736d-404d-ba9a-aaa01f843eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8e2f75-736d-404d-ba9a-aaa01f843eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fba03f5-71a3-4022-8d4b-62ebc3cbd1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fba03f5-71a3-4022-8d4b-62ebc3cbd1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeaa770-81f8-4a90-8f23-45c3aa6b95b6', 'volume_name': 'volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94e3d34-75f7-49cd-9827-7fc6e53555c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94e3d34-75f7-49cd-9827-7fc6e53555c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feceb091-d62d-4a9f-bd10-f7353874875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Volume 2eeaa770-81f8-4a90-8f23-45c3aa6b95b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6', 'volume_size': 1} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-353984312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeaa770-81f8-4a90-8f23-45c3aa6b95b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8196cddee8749e0874aefbff29e094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:54Z,use_quota=True,user_id='f4a323af8ba34e3a9a191f7312a7528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Creating volume 2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:54 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:05:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:54 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 1073741824 Sep 01 02:05:54 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:55 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 1073741824" returned: 0 in 0.698s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:55 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 Sep 01 02:05:55 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:55 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6" returned: 0 in 0.359s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feceb091-d62d-4a9f-bd10-f7353874875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5692bc34-2c6b-406f-9e74-522576294c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Volume volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 (2eeaa770-81f8-4a90-8f23-45c3aa6b95b6): created successfully Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5692bc34-2c6b-406f-9e74-522576294c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Flow 'volume_create_manager' (7fe7c383-2676-448e-afc3-45062e6cb4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-39016df0-d3ea-488b-a082-d08b68b47fc3 tempest-VolumesListAdminTestJSON-1016478759 None] Created volume successfully. Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Flow 'volume_create_manager' (25abf1be-434c-4ba8-9036-d838e9739ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6b2f5c-b2cd-4bf1-b4b9-60db5f652f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6b2f5c-b2cd-4bf1-b4b9-60db5f652f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890170740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb194c63-3626-436d-aad4-c4e3e376027d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8196cddee8749e0874aefbff29e094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:57Z,use_quota=True,user_id='f4a323af8ba34e3a9a191f7312a7528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d07e90-6209-4594-9a6a-5c70d88ffb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d07e90-6209-4594-9a6a-5c70d88ffb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30186a78-70dd-4b4f-8cc5-5d5d1c480125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30186a78-70dd-4b4f-8cc5-5d5d1c480125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb194c63-3626-436d-aad4-c4e3e376027d', 'volume_name': 'volume-cb194c63-3626-436d-aad4-c4e3e376027d', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79422cad-fb6c-4844-91bc-dd0a054fb888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79422cad-fb6c-4844-91bc-dd0a054fb888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80181e4d-49a8-4ff0-bcef-6b1638fcf140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:57 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Volume cb194c63-3626-436d-aad4-c4e3e376027d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb194c63-3626-436d-aad4-c4e3e376027d', 'volume_size': 1} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890170740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb194c63-3626-436d-aad4-c4e3e376027d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8196cddee8749e0874aefbff29e094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:57Z,use_quota=True,user_id='f4a323af8ba34e3a9a191f7312a7528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Creating volume cb194c63-3626-436d-aad4-c4e3e376027d {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:57 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:57 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d 1073741824 Sep 01 02:05:57 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:57 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d 1073741824" returned: 0 in 0.465s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:57 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d Sep 01 02:05:57 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:58 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d" returned: 0 in 0.319s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80181e4d-49a8-4ff0-bcef-6b1638fcf140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb194c63-3626-436d-aad4-c4e3e376027d', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f0c7ab-c03b-4306-9484-1abf9d5b2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:58 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Volume volume-cb194c63-3626-436d-aad4-c4e3e376027d (cb194c63-3626-436d-aad4-c4e3e376027d): created successfully Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f0c7ab-c03b-4306-9484-1abf9d5b2838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Flow 'volume_create_manager' (25abf1be-434c-4ba8-9036-d838e9739ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9862c971-2b9f-4468-b13a-12fa2f0a6392 tempest-VolumesListAdminTestJSON-1016478759 None] Created volume successfully. Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Flow 'volume_create_manager' (5bd6aa9f-4fc7-4e9f-b923-d3406312c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bd09a8-f65e-4f9c-bcb5-0a94a6f529fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bd09a8-f65e-4f9c-bcb5-0a94a6f529fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1315382423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d771a8-cd04-4355-9749-71182b2f7db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af25f6ab2cc841cd80fccce2e705b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:00Z,use_quota=True,user_id='a57f0b89490f41d6aafd362beae0e316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b280c166-a492-4da0-bb4c-eee2350ed878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b280c166-a492-4da0-bb4c-eee2350ed878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4143b5cb-08c2-47e6-9c9e-be185a37d07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4143b5cb-08c2-47e6-9c9e-be185a37d07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d771a8-cd04-4355-9749-71182b2f7db7', 'volume_name': 'volume-11d771a8-cd04-4355-9749-71182b2f7db7', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a09e0e0-d030-4c2a-8d71-2d18c935d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a09e0e0-d030-4c2a-8d71-2d18c935d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6206667-9929-49fb-a34c-20c917bda689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Volume 11d771a8-cd04-4355-9749-71182b2f7db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d771a8-cd04-4355-9749-71182b2f7db7', 'volume_size': 1} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1315382423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d771a8-cd04-4355-9749-71182b2f7db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af25f6ab2cc841cd80fccce2e705b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:00Z,use_quota=True,user_id='a57f0b89490f41d6aafd362beae0e316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Creating volume 11d771a8-cd04-4355-9749-71182b2f7db7 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:59 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:05:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:59 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 1073741824 Sep 01 02:05:59 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Flow 'volume_create_manager' (f9d61b5d-77da-4e2e-a1e6-7323815fc0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ea4059-ea3e-4a5a-b53d-380bf340b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ea4059-ea3e-4a5a-b53d-380bf340b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-207466916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e46de31-7a80-4f8b-ae5a-47ca3342b263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8196cddee8749e0874aefbff29e094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:00Z,use_quota=True,user_id='f4a323af8ba34e3a9a191f7312a7528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9165069a-a5ae-45a1-82ec-9a8870da4850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9165069a-a5ae-45a1-82ec-9a8870da4850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17137620-1eeb-442f-aa10-9198b0df5515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17137620-1eeb-442f-aa10-9198b0df5515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e46de31-7a80-4f8b-ae5a-47ca3342b263', 'volume_name': 'volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28ebc14-78f7-4f1e-ac38-2d0c707d600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28ebc14-78f7-4f1e-ac38-2d0c707d600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdddd288-ec99-412e-b501-0cd68c580904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Volume 7e46de31-7a80-4f8b-ae5a-47ca3342b263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263', 'volume_size': 1} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:00 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 1073741824" returned: 0 in 0.578s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:00 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 Sep 01 02:06:00 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:00 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-207466916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e46de31-7a80-4f8b-ae5a-47ca3342b263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8196cddee8749e0874aefbff29e094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:00Z,use_quota=True,user_id='f4a323af8ba34e3a9a191f7312a7528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Creating volume 7e46de31-7a80-4f8b-ae5a-47ca3342b263 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:00 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6206667-9929-49fb-a34c-20c917bda689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d771a8-cd04-4355-9749-71182b2f7db7', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357a7105-9e2e-4c0d-91ac-89dedda2a927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 1073741824 Sep 01 02:06:00 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Volume volume-11d771a8-cd04-4355-9749-71182b2f7db7 (11d771a8-cd04-4355-9749-71182b2f7db7): created successfully Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357a7105-9e2e-4c0d-91ac-89dedda2a927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Flow 'volume_create_manager' (5bd6aa9f-4fc7-4e9f-b923-d3406312c458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-40fdc4e2-217f-4954-8c5d-86d46abf5c0a tempest-AttachVolumeNegativeTest-747698300 None] Created volume successfully. Sep 01 02:06:01 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 1073741824" returned: 0 in 0.512s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:01 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 Sep 01 02:06:01 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:01 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdddd288-ec99-412e-b501-0cd68c580904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25029a39-f842-412d-be35-f2a7cdaf371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Volume volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 (7e46de31-7a80-4f8b-ae5a-47ca3342b263): created successfully Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25029a39-f842-412d-be35-f2a7cdaf371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Flow 'volume_create_manager' (f9d61b5d-77da-4e2e-a1e6-7323815fc0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b6be6446-ce29-4ae9-ab7f-3fbef7760b81 tempest-VolumesListAdminTestJSON-1016478759 None] Created volume successfully. Sep 01 02:06:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ceb97606-90b9-4e79-b293-9e80a3cfc6c6 req-4393983c-7727-4f5f-93c1-02f6235886a5 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ceb97606-90b9-4e79-b293-9e80a3cfc6c6 req-4393983c-7727-4f5f-93c1-02f6235886a5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-ceb97606-90b9-4e79-b293-9e80a3cfc6c6 req-4393983c-7727-4f5f-93c1-02f6235886a5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-ceb97606-90b9-4e79-b293-9e80a3cfc6c6 req-4393983c-7727-4f5f-93c1-02f6235886a5 tempest-AttachVolumeNegativeTest-747698300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-11d771a8-cd04-4355-9749-71182b2f7db7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e1a914c-70e5-485d-9d00-8a43bcd907fe', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-ceb97606-90b9-4e79-b293-9e80a3cfc6c6 req-4393983c-7727-4f5f-93c1-02f6235886a5 tempest-AttachVolumeNegativeTest-747698300 None] attachment_update completed successfully. Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Flow 'volume_create_manager' (8014f664-9de6-4a91-8a66-be3036e1e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0696d86c-a741-4984-b59f-93870e0af4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0696d86c-a741-4984-b59f-93870e0af4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e405f28d-4105-4238-a7fd-4848ac418979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e67e6991b64201bd50ceba633da675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:03Z,use_quota=True,user_id='e8c3a346f3e24ed0b730b316dd192b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc881f11-3cc9-4e5d-ba76-e34d597de82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc881f11-3cc9-4e5d-ba76-e34d597de82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e257774-2a07-47ff-8ced-958db8bebf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e257774-2a07-47ff-8ced-958db8bebf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e405f28d-4105-4238-a7fd-4848ac418979', 'volume_name': 'volume-e405f28d-4105-4238-a7fd-4848ac418979', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82629199-0656-4a6a-ad24-a11557fca5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82629199-0656-4a6a-ad24-a11557fca5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f458b07e-0f23-482a-a424-1897de33a2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:03 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Volume e405f28d-4105-4238-a7fd-4848ac418979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e405f28d-4105-4238-a7fd-4848ac418979', 'volume_size': 1} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e405f28d-4105-4238-a7fd-4848ac418979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e67e6991b64201bd50ceba633da675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:03Z,use_quota=True,user_id='e8c3a346f3e24ed0b730b316dd192b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Creating volume e405f28d-4105-4238-a7fd-4848ac418979 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:03 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:03 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 1073741824 Sep 01 02:06:03 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:04 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 1073741824" returned: 0 in 0.582s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:04 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 Sep 01 02:06:04 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:04 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f458b07e-0f23-482a-a424-1897de33a2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e405f28d-4105-4238-a7fd-4848ac418979', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8e1948-7302-4573-ba8f-445dd98d2adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Volume volume-e405f28d-4105-4238-a7fd-4848ac418979 (e405f28d-4105-4238-a7fd-4848ac418979): created successfully Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8e1948-7302-4573-ba8f-445dd98d2adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Flow 'volume_create_manager' (8014f664-9de6-4a91-8a66-be3036e1e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d500b28b-adc3-43ea-b15b-74792b75f4ac tempest-VolumesListAdminTestJSON-622635093 None] Created volume successfully. Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Acquiring lock "cinder-e405f28d-4105-4238-a7fd-4848ac418979-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Lock "cinder-e405f28d-4105-4238-a7fd-4848ac418979-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Acquiring lock "cinder-quobyte-e405f28d-4105-4238-a7fd-4848ac418979" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Lock "cinder-quobyte-e405f28d-4105-4238-a7fd-4848ac418979" acquired by "delete_volume" :: waited 0.046s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5f5907-7936-4ddc-b425-2bc6b88aa61e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "cinder-7e46de31-7a80-4f8b-ae5a-47ca3342b263-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-7e46de31-7a80-4f8b-ae5a-47ca3342b263-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:05 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 Sep 01 02:06:05 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "cinder-quobyte-7e46de31-7a80-4f8b-ae5a-47ca3342b263" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-quobyte-7e46de31-7a80-4f8b-ae5a-47ca3342b263" acquired by "delete_volume" :: waited 0.042s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a308c78-a817-4e0f-9f6d-543c31a0be5b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:06 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 Sep 01 02:06:06 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979" returned: 0 in 0.602s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:06 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979 Sep 01 02:06:06 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e405f28d-4105-4238-a7fd-4848ac418979" returned: 0 in 0.427s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Lock "cinder-quobyte-e405f28d-4105-4238-a7fd-4848ac418979" released by "delete_volume" :: held 1.121s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:06 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263" returned: 0 in 0.803s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:07 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263 Sep 01 02:06:07 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Created reservations ['beb2d8e3-8f39-4aa4-9014-ca8c2a98c29c', '7e261ac9-b64d-4cf8-acb9-f7d1dc3502c9', '00e104fc-f5ff-495d-a7e5-d57296720275', '99be7cb1-4a1e-44b1-a2c6-6cc2db1cde10'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:07 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:07 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:07 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e46de31-7a80-4f8b-ae5a-47ca3342b263" returned: 0 in 0.548s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-quobyte-7e46de31-7a80-4f8b-ae5a-47ca3342b263" released by "delete_volume" :: held 1.458s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Created reservations ['a38c44d8-530a-4e3a-8be4-c150811506e5', '47ba68b1-dec9-4f50-9261-8326d63e4f1b', 'e5baf90f-e887-4bab-a549-48a1d22811f2', '929dd17d-0b22-459a-8348-e1b81299bce1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:07 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Deleted volume successfully. Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb5540d2-cbb1-47bc-845a-d264c764229d tempest-VolumesListAdminTestJSON-622635093 None] Lock "cinder-e405f28d-4105-4238-a7fd-4848ac418979-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:07 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:07 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:08 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "cinder-cb194c63-3626-436d-aad4-c4e3e376027d-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.458s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Deleted volume successfully. Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-cb194c63-3626-436d-aad4-c4e3e376027d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e46f564b-f874-43a5-8791-7323380affcd tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-7e46de31-7a80-4f8b-ae5a-47ca3342b263-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "cinder-quobyte-cb194c63-3626-436d-aad4-c4e3e376027d" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-quobyte-cb194c63-3626-436d-aad4-c4e3e376027d" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97aa900-9487-477c-a902-3d560d1c2c3a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:08 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d Sep 01 02:06:08 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:08 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d" returned: 0 in 0.471s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:08 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d Sep 01 02:06:08 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cb194c63-3626-436d-aad4-c4e3e376027d" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-quobyte-cb194c63-3626-436d-aad4-c4e3e376027d" released by "delete_volume" :: held 0.809s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Created reservations ['d586efb4-0f9f-436f-96de-dd737a4c08c4', '8f425666-3946-439f-bd60-b17bcfd33e3e', 'c9d4e613-7c39-43c2-97fa-756b58a1e1fb', '478c08f6-e9da-49fd-9c35-397d7d9dd4df'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:09 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "cinder-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "cinder-quobyte-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-quobyte-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2afda2c-840a-42f1-be3c-7c7a1bfc57b9]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.491s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Deleted volume successfully. Sep 01 02:06:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-13d52b9b-17cb-485a-866a-35b126d7106b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-cb194c63-3626-436d-aad4-c4e3e376027d-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:10 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 Sep 01 02:06:10 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6" returned: 0 in 0.469s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6 Sep 01 02:06:10 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6" returned: 0 in 0.292s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-quobyte-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6" released by "delete_volume" :: held 0.833s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Created reservations ['e81c2c61-8443-4560-bf8a-caac1fdc733e', 'fc3b8b91-6942-4b05-8ad9-9bc32b963640', '2020e798-964a-40b9-bd5a-2b349070ad45', '6fc6b8ea-da79-4ea9-8b43-4e5517bc4f69'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:10 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:11 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.329s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:11 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:11 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Deleted volume successfully. Sep 01 02:06:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4e18cb61-ef95-403a-9a0a-63bc66f9025b tempest-VolumesListAdminTestJSON-1016478759 None] Lock "cinder-2eeaa770-81f8-4a90-8f23-45c3aa6b95b6-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Flow 'volume_create_manager' (951de17c-ed90-41d9-9a6f-4921a4308bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b16080b-6047-4334-b0f8-13e8852f00c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b16080b-6047-4334-b0f8-13e8852f00c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-314570987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d5173e-1961-4039-86a9-8b3d262cc11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58ed15645384bc88fd811053e3175bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:17Z,use_quota=True,user_id='62fd9efa89324334af5258315aae48c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96ddd11-db02-4706-8e39-d2bc54906c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96ddd11-db02-4706-8e39-d2bc54906c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73e25e6-47db-4f85-9a50-7a0055ba102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73e25e6-47db-4f85-9a50-7a0055ba102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d5173e-1961-4039-86a9-8b3d262cc11b', 'volume_name': 'volume-f1d5173e-1961-4039-86a9-8b3d262cc11b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5b3a8d-85e3-489f-8831-da02b5ba72db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5b3a8d-85e3-489f-8831-da02b5ba72db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417b781d-0cde-4fc5-941b-48d89f3227c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Volume f1d5173e-1961-4039-86a9-8b3d262cc11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d5173e-1961-4039-86a9-8b3d262cc11b', 'volume_size': 1} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-314570987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d5173e-1961-4039-86a9-8b3d262cc11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58ed15645384bc88fd811053e3175bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:17Z,use_quota=True,user_id='62fd9efa89324334af5258315aae48c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Creating volume f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:17 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b 1073741824 Sep 01 02:06:17 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b 1073741824" returned: 0 in 0.647s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b Sep 01 02:06:18 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b" returned: 0 in 0.354s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417b781d-0cde-4fc5-941b-48d89f3227c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d5173e-1961-4039-86a9-8b3d262cc11b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3694e7-6676-464f-8cee-920598c512c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Volume volume-f1d5173e-1961-4039-86a9-8b3d262cc11b (f1d5173e-1961-4039-86a9-8b3d262cc11b): created successfully Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3694e7-6676-464f-8cee-920598c512c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Flow 'volume_create_manager' (951de17c-ed90-41d9-9a6f-4921a4308bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2135e43e-c96d-4517-818b-e5ec2a520207 tempest-SnapshotMetadataTestJSON-541452297 None] Created volume successfully. Sep 01 02:06:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Creating offline snapshot f418c92f-99cd-4659-9fbb-6982b173418f of volume f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:19 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d540108d-7a8d-479b-acba-100a01316645]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:19 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b Sep 01 02:06:19 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b" returned: 0 in 0.415s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f 1G Sep 01 02:06:20 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f 1G" returned: 0 in 0.430s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d5173e-1961-4039-86a9-8b3d262cc11b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d5173e-1961-4039-86a9-8b3d262cc11b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f Sep 01 02:06:20 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d5173e-1961-4039-86a9-8b3d262cc11b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f" returned: 0 in 0.309s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f is being set with open permissions: ugo+rw Sep 01 02:06:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f Sep 01 02:06:20 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:21 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:21 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info Sep 01 02:06:21 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:21 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:21 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info is being set with open permissions: ugo+rw Sep 01 02:06:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:21 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info Sep 01 02:06:21 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:21 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.info" returned: 0 in 0.259s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9f8ffb8c-de3b-43c9-b35e-bfbf8bb087c8 tempest-SnapshotMetadataTestJSON-541452297 None] Create snapshot completed successfully Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "cinder-f418c92f-99cd-4659-9fbb-6982b173418f-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-f418c92f-99cd-4659-9fbb-6982b173418f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "cinder-quobyte-f1d5173e-1961-4039-86a9-8b3d262cc11b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-quobyte-f1d5173e-1961-4039-86a9-8b3d262cc11b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "cinder-quobyte-f418c92f-99cd-4659-9fbb-6982b173418f" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-quobyte-f418c92f-99cd-4659-9fbb-6982b173418f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Deleting offline snapshot f418c92f-99cd-4659-9fbb-6982b173418f of volume f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] snapshot_file for this snap is: volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb92b9a-dc0f-42d7-a2ef-db84a85157e6]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:23 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f Sep 01 02:06:23 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f" returned: 0 in 0.431s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1d5173e-1961-4039-86a9-8b3d262cc11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:06:24 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f34e8a4-051f-4f34-8f23-c451392bf6db]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b Sep 01 02:06:24 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b" returned: 0 in 0.449s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f Sep 01 02:06:24 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:25 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f" returned: 0 in 0.407s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f Sep 01 02:06:25 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:25 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b.f418c92f-99cd-4659-9fbb-6982b173418f" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-quobyte-f418c92f-99cd-4659-9fbb-6982b173418f" released by "_delete_snapshot" :: held 1.669s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-quobyte-f1d5173e-1961-4039-86a9-8b3d262cc11b" released by "delete_snapshot" :: held 1.704s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Created reservations ['b23fc22d-1398-4978-8b14-345d606e4e36', '1aa20892-2ed2-46ad-b458-0737e3ff9a6d', 'daa6ff49-7985-4f80-8f48-13544d0ba858', '4f4012aa-a3fc-4d0c-9cfe-65ee8d5a3772'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:25 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Delete snapshot completed successfully. Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-029c7074-d574-473d-8761-c7a275b7a65f tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-f418c92f-99cd-4659-9fbb-6982b173418f-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "cinder-f1d5173e-1961-4039-86a9-8b3d262cc11b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-f1d5173e-1961-4039-86a9-8b3d262cc11b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "cinder-quobyte-f1d5173e-1961-4039-86a9-8b3d262cc11b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-quobyte-f1d5173e-1961-4039-86a9-8b3d262cc11b" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e0c686-9e4e-4184-ae8b-9da7652d9297]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:26 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b Sep 01 02:06:26 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b" returned: 0 in 0.385s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:26 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b Sep 01 02:06:26 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f1d5173e-1961-4039-86a9-8b3d262cc11b" returned: 0 in 0.266s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-quobyte-f1d5173e-1961-4039-86a9-8b3d262cc11b" released by "delete_volume" :: held 0.719s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Created reservations ['9d97bf74-6684-4cef-935c-22763a10cd11', '236a814a-4cad-4113-9328-8a37dbfd58c1', '4a24ecc9-f542-4778-95c8-7a440ffcccbd', '34a4e380-ee7a-4e2d-a8b5-0a33e32415e8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:26 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:26 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:27 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.338s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:27 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Deleted volume successfully. Sep 01 02:06:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53c03b9a-349d-465b-9ba7-390bfb49a5cc tempest-SnapshotMetadataTestJSON-541452297 None] Lock "cinder-f1d5173e-1961-4039-86a9-8b3d262cc11b-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:28 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:28 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:28 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:06:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:06:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-5fd74051-2eaf-406c-a0b5-4f16da53d5d3 tempest-TestShelveInstance-1733731671 None] Terminate volume connection completed successfully. Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-5fd74051-2eaf-406c-a0b5-4f16da53d5d3 tempest-TestShelveInstance-1733731671 None] Deleting attachment 6cd4dc5e-5305-480b-8dec-929d269e298f. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Flow 'volume_create_manager' (60afc2c3-f3c7-4419-b439-8340dbf2a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b1d064-6583-419a-9648-af5bd742c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Acquiring lock "cinder-d00a9e96-2662-418c-9919-cbfc3d11dd98-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b1d064-6583-419a-9648-af5bd742c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-26469770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b311f781-aa8a-44c2-8bd2-403bd3cee1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9c6a125387427993dc66b667233a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:33Z,use_quota=True,user_id='61d00c5bb23741e2b5a04280759d6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f935263-3f0a-4b1c-9041-95308ca44719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f935263-3f0a-4b1c-9041-95308ca44719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc9763b-b268-4247-a401-88fa68f90680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc9763b-b268-4247-a401-88fa68f90680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b311f781-aa8a-44c2-8bd2-403bd3cee1eb', 'volume_name': 'volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cf60fd-9935-4af2-ac6f-92bacebd38fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cf60fd-9935-4af2-ac6f-92bacebd38fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cd80c1-7011-460d-8a9e-b94a7253cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Volume b311f781-aa8a-44c2-8bd2-403bd3cee1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb', 'volume_size': 1} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-26469770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b311f781-aa8a-44c2-8bd2-403bd3cee1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9c6a125387427993dc66b667233a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:33Z,use_quota=True,user_id='61d00c5bb23741e2b5a04280759d6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Creating volume b311f781-aa8a-44c2-8bd2-403bd3cee1eb {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:33 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Lock "cinder-d00a9e96-2662-418c-9919-cbfc3d11dd98-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:33 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb 1073741824 Sep 01 02:06:33 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Acquiring lock "cinder-quobyte-d00a9e96-2662-418c-9919-cbfc3d11dd98" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Lock "cinder-quobyte-d00a9e96-2662-418c-9919-cbfc3d11dd98" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5fc50-dd6e-4c0a-8870-7123c9879923]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 Sep 01 02:06:34 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb 1073741824" returned: 0 in 0.710s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98" returned: 0 in 0.661s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb Sep 01 02:06:34 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98 Sep 01 02:06:34 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb" returned: 0 in 0.303s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cd80c1-7011-460d-8a9e-b94a7253cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4b107c-1f9c-414c-af0b-7e58b95cae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:34 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Volume volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb (b311f781-aa8a-44c2-8bd2-403bd3cee1eb): created successfully Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4b107c-1f9c-414c-af0b-7e58b95cae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Flow 'volume_create_manager' (60afc2c3-f3c7-4419-b439-8340dbf2a090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d00a9e96-2662-418c-9919-cbfc3d11dd98" returned: 0 in 0.355s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Lock "cinder-quobyte-d00a9e96-2662-418c-9919-cbfc3d11dd98" released by "delete_volume" :: held 1.080s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4ac74398-95c3-4d7e-ac68-6d6c996e3582 tempest-VolumesTransfersTest-1916849802 None] Created volume successfully. Sep 01 02:06:34 devstack cinder-volume[87404]: DEBUG cinder.quota [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Created reservations ['9fcf582e-a9ad-4f67-9f02-6da9d32af492', '8ab8ce2e-255d-4d0d-b8f2-27e3b20495da', 'a9a04018-75b0-43eb-a03d-d84d5a78e401', '88dcadde-8602-414a-827d-431a42e4d543'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:35 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG cinder.manager [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Deleted volume successfully. Sep 01 02:06:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-2fbf6143-fab4-4074-8116-1ef117f184f1 req-d9604be0-8896-4b0f-9128-9beb69265ae6 tempest-TestShelveInstance-1733731671 None] Lock "cinder-d00a9e96-2662-418c-9919-cbfc3d11dd98-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8dde518e-bb19-46f3-9976-dec88d37930b tempest-VolumesTransfersTest-372509471 None] Transfer volume completed successfully. Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Acquiring lock "cinder-b311f781-aa8a-44c2-8bd2-403bd3cee1eb-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-b311f781-aa8a-44c2-8bd2-403bd3cee1eb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Acquiring lock "cinder-quobyte-b311f781-aa8a-44c2-8bd2-403bd3cee1eb" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-quobyte-b311f781-aa8a-44c2-8bd2-403bd3cee1eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8becbb-71d2-44bb-87ce-89755a353dbf]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:37 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb Sep 01 02:06:37 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Acquiring lock "cinder-dc5b8db4-b033-4bf1-a69b-c27568d79623-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "cinder-dc5b8db4-b033-4bf1-a69b-c27568d79623-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Acquiring lock "cinder-quobyte-dc5b8db4-b033-4bf1-a69b-c27568d79623" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "cinder-quobyte-dc5b8db4-b033-4bf1-a69b-c27568d79623" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e28f19-e6af-47a3-898a-24bd83891af3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 Sep 01 02:06:38 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb" returned: 0 in 0.596s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb Sep 01 02:06:38 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623" returned: 0 in 0.474s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b311f781-aa8a-44c2-8bd2-403bd3cee1eb" returned: 0 in 0.277s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623 Sep 01 02:06:38 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-quobyte-b311f781-aa8a-44c2-8bd2-403bd3cee1eb" released by "delete_volume" :: held 0.941s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Created reservations ['a49c720a-45d2-42bb-92d0-7bddb54a85d5', '69fbd506-e416-4d02-89c2-966f9feafd46', '80f4f3c3-448f-40db-975e-862ec7af7291', '4d8e2247-5cf6-473a-b9ac-959522112447'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:38 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc5b8db4-b033-4bf1-a69b-c27568d79623" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "cinder-quobyte-dc5b8db4-b033-4bf1-a69b-c27568d79623" released by "delete_volume" :: held 0.820s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Created reservations ['6aab65db-838f-4628-9580-f03259e7d982', '8f6cbdc8-f3a4-4780-9178-e5087b679bbc', 'c48f0b27-e168-44be-bea8-832324c138c2', '1522aced-d6a8-4c36-aa1e-87e0556bf536'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:39 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:39 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:39 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.501s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Deleted volume successfully. Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-08fbb600-ae89-4022-ad0a-6d642d5d7949 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-b311f781-aa8a-44c2-8bd2-403bd3cee1eb-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:39 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.412s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Deleted volume successfully. Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5ce7b75e-8f11-4578-8e15-2fdfc025202a tempest-AttachVolumeShelveTestJSON-496923693 None] Lock "cinder-dc5b8db4-b033-4bf1-a69b-c27568d79623-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Flow 'volume_create_manager' (213cd6fd-d398-40ee-99fd-bd27dc6964fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdefba2a-e003-4c27-bfaa-2fd8bc5571ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdefba2a-e003-4c27-bfaa-2fd8bc5571ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1625253579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fea5d1-0961-45f3-9659-d9655aab9fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9c6a125387427993dc66b667233a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:40Z,use_quota=True,user_id='61d00c5bb23741e2b5a04280759d6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1dc918-1e5b-4ac3-a1a4-88eeca1e7005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1dc918-1e5b-4ac3-a1a4-88eeca1e7005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70726dd3-68f2-48a7-986d-82cf3e524f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70726dd3-68f2-48a7-986d-82cf3e524f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50fea5d1-0961-45f3-9659-d9655aab9fcc', 'volume_name': 'volume-50fea5d1-0961-45f3-9659-d9655aab9fcc', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61aa526-7acb-4e39-9503-1108b6611943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61aa526-7acb-4e39-9503-1108b6611943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c116111-e5c6-4895-a830-9ec8b9ae6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Volume 50fea5d1-0961-45f3-9659-d9655aab9fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50fea5d1-0961-45f3-9659-d9655aab9fcc', 'volume_size': 1} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1625253579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fea5d1-0961-45f3-9659-d9655aab9fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9c6a125387427993dc66b667233a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:40Z,use_quota=True,user_id='61d00c5bb23741e2b5a04280759d6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Creating volume 50fea5d1-0961-45f3-9659-d9655aab9fcc {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:40 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:40 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc 1073741824 Sep 01 02:06:40 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:40 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc 1073741824" returned: 0 in 0.595s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:40 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc Sep 01 02:06:40 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:41 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc" returned: 0 in 0.364s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c116111-e5c6-4895-a830-9ec8b9ae6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50fea5d1-0961-45f3-9659-d9655aab9fcc', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d537d180-1ff0-4fa4-9f12-8dce0feb729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Volume volume-50fea5d1-0961-45f3-9659-d9655aab9fcc (50fea5d1-0961-45f3-9659-d9655aab9fcc): created successfully Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d537d180-1ff0-4fa4-9f12-8dce0feb729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Flow 'volume_create_manager' (213cd6fd-d398-40ee-99fd-bd27dc6964fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:41 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-293b77a9-b17f-4f45-929f-753d2759bea9 tempest-VolumesTransfersTest-1916849802 None] Created volume successfully. Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Acquiring lock "cinder-50fea5d1-0961-45f3-9659-d9655aab9fcc-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-50fea5d1-0961-45f3-9659-d9655aab9fcc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Acquiring lock "cinder-quobyte-50fea5d1-0961-45f3-9659-d9655aab9fcc" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-quobyte-50fea5d1-0961-45f3-9659-d9655aab9fcc" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[081338f6-48a8-492b-a97c-4d504c1b545d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:42 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc Sep 01 02:06:42 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc" returned: 0 in 0.445s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:42 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc Sep 01 02:06:42 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50fea5d1-0961-45f3-9659-d9655aab9fcc" returned: 0 in 0.308s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-quobyte-50fea5d1-0961-45f3-9659-d9655aab9fcc" released by "delete_volume" :: held 0.805s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Created reservations ['78f750a9-8152-4f39-b052-4065c3533824', 'cee6949f-12b2-4b29-9dfe-cc307fd51cc1', 'a1791b9f-52b7-4ace-945f-2b65a8318143', '34fa09f1-c668-421c-8ed2-f0508311829f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:43 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Deleted volume successfully. Sep 01 02:06:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09dfb151-44d9-4bf1-ab23-e44efa2b9dd7 tempest-VolumesTransfersTest-1041149784 None] Lock "cinder-50fea5d1-0961-45f3-9659-d9655aab9fcc-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:50 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-b3158db5-a2f7-4067-bb44-2e763a0feac0 req-bcc655d0-1bf7-4c92-b3fd-b95edf28731f tempest-AttachVolumeNegativeTest-747698300 None] Terminate volume connection completed successfully. Sep 01 02:06:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-b3158db5-a2f7-4067-bb44-2e763a0feac0 req-bcc655d0-1bf7-4c92-b3fd-b95edf28731f tempest-AttachVolumeNegativeTest-747698300 None] Deleting attachment 4e1a914c-70e5-485d-9d00-8a43bcd907fe. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=85,cinder:UPDATE=99,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=111,cinder:SELECT=74,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Flow 'volume_create_manager' (07c882a4-c440-4888-a6b2-c1a8154901f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2bb2be-08cd-4bfd-8760-0c32f92da7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2bb2be-08cd-4bfd-8760-0c32f92da7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1400872661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31bb467-340c-418d-958b-24dff25d3ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1e2b5e975847cebe01778f7fcf487c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:54Z,use_quota=True,user_id='af59fe3dcae7490baaeec5b5eec181f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9f478-f282-4f3d-aa68-5cb6b934ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9f478-f282-4f3d-aa68-5cb6b934ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de7d8db-fdd7-4c7a-9d51-255ef613a039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de7d8db-fdd7-4c7a-9d51-255ef613a039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31bb467-340c-418d-958b-24dff25d3ac9', 'volume_name': 'volume-c31bb467-340c-418d-958b-24dff25d3ac9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baff3cb0-422b-4db0-a5ff-ed27a671aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baff3cb0-422b-4db0-a5ff-ed27a671aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7910c59-45e7-4e29-a788-a281ef715e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Volume c31bb467-340c-418d-958b-24dff25d3ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31bb467-340c-418d-958b-24dff25d3ac9', 'volume_size': 1} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1400872661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31bb467-340c-418d-958b-24dff25d3ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1e2b5e975847cebe01778f7fcf487c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:54Z,use_quota=True,user_id='af59fe3dcae7490baaeec5b5eec181f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Creating volume c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:54 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:54 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 1073741824 Sep 01 02:06:54 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:54 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Flow 'volume_create_manager' (9e3f8377-3d95-4673-a3e4-e1774a399796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c5c1c2-5c5f-4222-a697-713102e0171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c5c1c2-5c5f-4222-a697-713102e0171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-80264976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d054f84946c406a9f4a18e1f795c7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:55Z,use_quota=True,user_id='f730b05a781940b7b13db144027eebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecafbda-1e16-471d-bc0f-4f5ab0ba258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecafbda-1e16-471d-bc0f-4f5ab0ba258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81684b6-2b5b-4eb7-89ab-1da23231dffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81684b6-2b5b-4eb7-89ab-1da23231dffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4', 'volume_name': 'volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a219ed-32e1-4147-a2fb-a7df006a915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a219ed-32e1-4147-a2fb-a7df006a915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fc4fca-5436-4bc8-b4c2-d5c08717c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Volume c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4', 'volume_size': 1} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 1073741824" returned: 0 in 0.755s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:55 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 Sep 01 02:06:55 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:55 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-80264976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d054f84946c406a9f4a18e1f795c7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:55Z,use_quota=True,user_id='f730b05a781940b7b13db144027eebb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Creating volume c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:55 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7910c59-45e7-4e29-a788-a281ef715e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31bb467-340c-418d-958b-24dff25d3ac9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 1073741824 Sep 01 02:06:55 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641644ba-e692-4269-afd3-e0101d157da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Volume volume-c31bb467-340c-418d-958b-24dff25d3ac9 (c31bb467-340c-418d-958b-24dff25d3ac9): created successfully Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641644ba-e692-4269-afd3-e0101d157da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Flow 'volume_create_manager' (07c882a4-c440-4888-a6b2-c1a8154901f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-785cae1f-c0b6-4577-b09b-d015897c53ed tempest-VolumesCloneTest-701735700 None] Created volume successfully. Sep 01 02:06:56 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 1073741824" returned: 0 in 0.559s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:56 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 Sep 01 02:06:56 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:56 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fc4fca-5436-4bc8-b4c2-d5c08717c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e87618-e637-4919-82bd-3d349a6e2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Volume volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 (c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4): created successfully Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e87618-e637-4919-82bd-3d349a6e2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Flow 'volume_create_manager' (9e3f8377-3d95-4673-a3e4-e1774a399796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-237db5b3-14f8-4887-b4ef-1987509b1816 req-4187fc2b-eaf7-45cd-8fad-976ed1d249df tempest-VolumesGetTestJSON-1978181899 None] Created volume successfully. Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Flow 'volume_create_manager' (519c2cc1-7b42-4785-8ab5-e4d38ab792fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5bcb89-dc4f-4d03-9ed5-4d4cda582ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5bcb89-dc4f-4d03-9ed5-4d4cda582ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1214813112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ab89e-5b0d-424f-a85f-be56e9d07c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1e2b5e975847cebe01778f7fcf487c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c31bb467-340c-418d-958b-24dff25d3ac9,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:57Z,use_quota=True,user_id='af59fe3dcae7490baaeec5b5eec181f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6504d679-4ff6-46de-a7d1-6297b035aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6504d679-4ff6-46de-a7d1-6297b035aeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab697473-665b-4b68-8a2c-5475701d4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab697473-665b-4b68-8a2c-5475701d4467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b6ab89e-5b0d-424f-a85f-be56e9d07c9d', 'volume_name': 'volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d', 'volume_size': 2, 'source_volid': 'c31bb467-340c-418d-958b-24dff25d3ac9', 'source_volstatus': 'available'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02f2769-28f2-406f-9b0e-dcf80e21115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02f2769-28f2-406f-9b0e-dcf80e21115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeae8bf-5ae3-46c0-895a-3bfd889eb8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:57 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Volume 8b6ab89e-5b0d-424f-a85f-be56e9d07c9d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d', 'volume_size': 2, 'source_volid': 'c31bb467-340c-418d-958b-24dff25d3ac9', 'source_volstatus': 'available'} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:57 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Cloning volume c31bb467-340c-418d-958b-24dff25d3ac9 to volume 8b6ab89e-5b0d-424f-a85f-be56e9d07c9d Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Creating offline snapshot 20cf332c-e333-46c4-be9b-f441059b60a0 of volume c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c53d9-411e-470f-b654-803b38659fb4]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 Sep 01 02:06:57 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:57 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9" returned: 0 in 0.533s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Acquiring lock "cinder-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:57 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 1G Sep 01 02:06:57 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Lock "cinder-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Acquiring lock "cinder-quobyte-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Lock "cinder-quobyte-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4720d4af-d475-43ea-a9ce-002c70fcdcf6]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 Sep 01 02:06:57 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 1G" returned: 0 in 0.621s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31bb467-340c-418d-958b-24dff25d3ac9 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31bb467-340c-418d-958b-24dff25d3ac9 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 Sep 01 02:06:58 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4" returned: 0 in 0.537s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4 Sep 01 02:06:58 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31bb467-340c-418d-958b-24dff25d3ac9 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0" returned: 0 in 0.368s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 is being set with open permissions: ugo+rw Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4" returned: 0 in 0.290s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 Sep 01 02:06:58 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Lock "cinder-quobyte-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4" released by "delete_volume" :: held 0.897s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG cinder.quota [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Created reservations ['dff71004-c34c-4ae3-a6e7-bd1626a5d301', 'd01a85b0-4af3-4feb-89e8-18b7e476dc0e', '2afc039f-c5a3-4a01-912a-aff3bc34361e', 'f85e7241-f957-48c0-873b-6d01d695ba2a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:06:58 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0" returned: 0 in 0.355s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info Sep 01 02:06:59 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:59 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.manager [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Deleted volume successfully. Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b358a1e6-140b-42be-91b0-1031012306de req-5b86a68e-5bfe-44ae-a751-3e23d89966b5 tempest-VolumesGetTestJSON-1978181899 None] Lock "cinder-c1348d4f-9aa5-4c03-8ee1-243c2b00b1e4-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:59 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info" returned: 0 in 0.394s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info is being set with open permissions: ugo+rw Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info Sep 01 02:06:59 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:59 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.info" returned: 0 in 0.345s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Acquiring lock "cinder-quobyte-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] snapshot: 20cf332c-e333-46c4-be9b-f441059b60a0, volume: 8b6ab89e-5b0d-424f-a85f-be56e9d07c9d, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3897eff7-0f2b-411a-96a6-402930fc820a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 Sep 01 02:07:00 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0" returned: 0 in 0.545s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c31bb467-340c-418d-958b-24dff25d3ac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee36bb-0348-4146-9f74-7d98562d7a05]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 Sep 01 02:07:00 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9" returned: 0 in 0.437s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:07:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d Sep 01 02:07:00 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:07 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" returned: 0 in 6.454s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:07:07 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Converted 1024.00 MB image at 158.63 MB/s Sep 01 02:07:07 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d is being set with open permissions: ugo+rw Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-76bd7bbc-41e0-4284-bd6e-e6a1b953dc7e tempest-BackendsCapabilitiesAdminTestsJSON-1099743011 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0434684753418, 'free_capacity_gb': 1774.0434684753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87404) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:07:07 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d Sep 01 02:07:07 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6abeca0d-0819-4281-ab3f-63dd66d2a587 tempest-BackendsCapabilitiesAdminTestsJSON-1099743011 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0434684753418, 'free_capacity_gb': 1774.0434684753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87404) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:07:07 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" returned: 0 in 0.394s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" released by "_copy_volume_from_snapshot" :: held 7.945s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Acquiring lock "cinder-quobyte-20cf332c-e333-46c4-be9b-f441059b60a0" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-20cf332c-e333-46c4-be9b-f441059b60a0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Deleting offline snapshot 20cf332c-e333-46c4-be9b-f441059b60a0 of volume c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] snapshot_file for this snap is: volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fedb7b6-bbe0-4c7b-969e-dbba26eb8ae3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:08 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 Sep 01 02:07:08 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:08 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0" returned: 0 in 0.612s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c31bb467-340c-418d-958b-24dff25d3ac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:08 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236c27a-f471-491c-b899-c78c85c33088]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:08 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 Sep 01 02:07:08 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:09 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=18,cinder:SELECT=10,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:09 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9" returned: 0 in 0.700s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:09 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 Sep 01 02:07:09 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:09 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0" returned: 0 in 0.438s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:09 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0 Sep 01 02:07:09 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:10 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9.20cf332c-e333-46c4-be9b-f441059b60a0" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-20cf332c-e333-46c4-be9b-f441059b60a0" released by "_delete_snapshot" :: held 2.272s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.107s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeae8bf-5ae3-46c0-895a-3bfd889eb8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d', 'volume_size': 2, 'source_volid': 'c31bb467-340c-418d-958b-24dff25d3ac9', 'source_volstatus': 'available'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aca79fd-037c-4280-9d16-1613c2918b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:10 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Volume volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d (8b6ab89e-5b0d-424f-a85f-be56e9d07c9d): created successfully Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aca79fd-037c-4280-9d16-1613c2918b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Flow 'volume_create_manager' (519c2cc1-7b42-4785-8ab5-e4d38ab792fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:10 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f3253d81-4c9c-4b0d-931f-ac6732c442e6 tempest-VolumesCloneTest-701735700 None] Created volume successfully. Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Acquiring lock "cinder-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Lock "cinder-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Acquiring lock "cinder-quobyte-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84022cb-663d-4daf-a09c-10ab565cfa53]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:10 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d Sep 01 02:07:10 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:11 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" returned: 0 in 0.509s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:11 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d Sep 01 02:07:11 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:11 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" returned: 0 in 0.323s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d" released by "delete_volume" :: held 0.893s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Created reservations ['b2423958-df47-4572-869b-0a689417d8c0', '910ebf0f-2750-46ea-b0fe-0a1ead562549', '15055e9a-794c-4992-9f49-bbebe6451d17', '931b5f6a-88a2-40b6-842e-52ad84d7f4c0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:11 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:11 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Acquiring lock "cinder-c31bb467-340c-418d-958b-24dff25d3ac9-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Lock "cinder-c31bb467-340c-418d-958b-24dff25d3ac9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Acquiring lock "cinder-quobyte-c31bb467-340c-418d-958b-24dff25d3ac9" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-c31bb467-340c-418d-958b-24dff25d3ac9" acquired by "delete_volume" :: waited 0.038s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65da59f-9c21-4332-a472-a72868f856a7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:12 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.662s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Deleted volume successfully. Sep 01 02:07:12 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 Sep 01 02:07:12 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b00bfea7-651b-4c8e-abb3-a383116728f0 tempest-VolumesCloneTest-701735700 None] Lock "cinder-8b6ab89e-5b0d-424f-a85f-be56e9d07c9d-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:12 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9" returned: 0 in 0.692s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:12 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9 Sep 01 02:07:12 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c31bb467-340c-418d-958b-24dff25d3ac9" returned: 0 in 0.529s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Lock "cinder-quobyte-c31bb467-340c-418d-958b-24dff25d3ac9" released by "delete_volume" :: held 1.410s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Created reservations ['5373bdee-3e6a-41ef-8fa8-6a75e92b2a1d', '4ad086a3-a1cc-489e-8c42-4a89ec38d7bc', '6207b9c7-0bb7-4491-9df1-627c47520b0b', 'af0e7edd-bd76-4292-9275-7749680a0a90'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:13 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.531s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:14 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Deleted volume successfully. Sep 01 02:07:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47de6080-c108-42a9-9afd-2aa6531df4c4 tempest-VolumesCloneTest-701735700 None] Lock "cinder-c31bb467-340c-418d-958b-24dff25d3ac9-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (6a5bab9d-1789-4a35-a22e-f7c7c0cf5772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9cbd1e-f30f-4871-a1a1-684c43ac7f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9cbd1e-f30f-4871-a1a1-684c43ac7f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263929630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395436a4-3b3a-4b39-87e2-9087293b7166,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:20Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0987a1-3024-42c3-9d4c-adf076d7018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0987a1-3024-42c3-9d4c-adf076d7018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5723a95d-2bb6-4086-a46b-690e402edd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5723a95d-2bb6-4086-a46b-690e402edd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395436a4-3b3a-4b39-87e2-9087293b7166', 'volume_name': 'volume-395436a4-3b3a-4b39-87e2-9087293b7166', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622d3385-4407-46c7-b308-005f6b7cc7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622d3385-4407-46c7-b308-005f6b7cc7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69fe939-b5f0-4b56-9427-d16686a83b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:20 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Volume 395436a4-3b3a-4b39-87e2-9087293b7166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395436a4-3b3a-4b39-87e2-9087293b7166', 'volume_size': 1} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263929630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395436a4-3b3a-4b39-87e2-9087293b7166,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:20Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Creating volume 395436a4-3b3a-4b39-87e2-9087293b7166 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:20 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:20 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 1073741824 Sep 01 02:07:20 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 1073741824" returned: 0 in 0.731s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:21 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 Sep 01 02:07:21 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69fe939-b5f0-4b56-9427-d16686a83b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395436a4-3b3a-4b39-87e2-9087293b7166', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf31b635-9809-4942-b9d1-61ce4b6f3563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Volume volume-395436a4-3b3a-4b39-87e2-9087293b7166 (395436a4-3b3a-4b39-87e2-9087293b7166): created successfully Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf31b635-9809-4942-b9d1-61ce4b6f3563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (6a5bab9d-1789-4a35-a22e-f7c7c0cf5772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-03e8fb7e-ca19-4182-a2df-5a3aaad0523a tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:07:23 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (a0009caf-0604-4fcb-9aa9-dc69a1d5c374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776117e6-f539-460c-8612-1e9fa8a39556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776117e6-f539-460c-8612-1e9fa8a39556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1730997445',display_name='tempest-VolumesGetTest-Volume-462840481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8480c91-2f0e-46df-b3cf-44600dfd0775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:24Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2eb59af-c327-4f36-9c75-fbb419ee3784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2eb59af-c327-4f36-9c75-fbb419ee3784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b2f368-4dce-4a27-be00-ca2792c472b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b2f368-4dce-4a27-be00-ca2792c472b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8480c91-2f0e-46df-b3cf-44600dfd0775', 'volume_name': 'volume-c8480c91-2f0e-46df-b3cf-44600dfd0775', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d59ff86-28f3-4c93-bd1c-dfdbef8417e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d59ff86-28f3-4c93-bd1c-dfdbef8417e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa891bbe-529e-445b-ab31-331850ad56f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Volume c8480c91-2f0e-46df-b3cf-44600dfd0775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8480c91-2f0e-46df-b3cf-44600dfd0775', 'volume_size': 1} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1730997445',display_name='tempest-VolumesGetTest-Volume-462840481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8480c91-2f0e-46df-b3cf-44600dfd0775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:24Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Creating volume c8480c91-2f0e-46df-b3cf-44600dfd0775 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:24 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:24 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 1073741824 Sep 01 02:07:24 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:24 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 1073741824" returned: 0 in 0.587s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:24 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 Sep 01 02:07:24 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:25 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775" returned: 0 in 0.464s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa891bbe-529e-445b-ab31-331850ad56f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8480c91-2f0e-46df-b3cf-44600dfd0775', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7882e83-e882-4292-be67-3368e6e33ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:25 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Volume volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 (c8480c91-2f0e-46df-b3cf-44600dfd0775): created successfully Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7882e83-e882-4292-be67-3368e6e33ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (a0009caf-0604-4fcb-9aa9-dc69a1d5c374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:25 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9ab7c0cb-417c-4563-b58b-a66ff668b634 tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:07:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-c8480c91-2f0e-46df-b3cf-44600dfd0775-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Lock "cinder-c8480c91-2f0e-46df-b3cf-44600dfd0775-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-c8480c91-2f0e-46df-b3cf-44600dfd0775" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-c8480c91-2f0e-46df-b3cf-44600dfd0775" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e3f50b-be1f-42ff-aabb-efa8b639ad6e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:26 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 Sep 01 02:07:26 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:27 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775" returned: 0 in 0.647s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775 Sep 01 02:07:27 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:27 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c8480c91-2f0e-46df-b3cf-44600dfd0775" returned: 0 in 0.313s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-c8480c91-2f0e-46df-b3cf-44600dfd0775" released by "delete_volume" :: held 1.052s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Created reservations ['666e3071-d6fb-4942-ae62-0d84e336552c', 'd2957f14-ebe7-420c-880d-7571d66a80df', 'ef162c8e-cb11-4a72-92ac-2172b748a405', '8ec39a69-51ad-48ee-822b-41fadfbce413'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:27 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.463s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-760fb37c-0407-4ec7-b64e-59829bb02469 tempest-VolumesGetTest-2079832754 None] Lock "cinder-c8480c91-2f0e-46df-b3cf-44600dfd0775-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:28 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-395436a4-3b3a-4b39-87e2-9087293b7166-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Lock "cinder-395436a4-3b3a-4b39-87e2-9087293b7166-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-395436a4-3b3a-4b39-87e2-9087293b7166" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-395436a4-3b3a-4b39-87e2-9087293b7166" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:28 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21bf2f0-be3b-4885-9b1b-83ed0a092292]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 Sep 01 02:07:29 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166" returned: 0 in 0.446s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166 Sep 01 02:07:29 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-395436a4-3b3a-4b39-87e2-9087293b7166" returned: 0 in 0.253s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-395436a4-3b3a-4b39-87e2-9087293b7166" released by "delete_volume" :: held 0.764s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Created reservations ['40adcbcb-92ae-4b2e-a33a-14ca30fa1652', '24943a05-0b77-43b4-b5e5-258e80b626bc', '188c38ab-1834-4494-a455-f62d5d2c1825', '9971de3b-372f-47c8-ba88-4a89e15d9a8f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:29 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:30 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cfba125-60a9-4035-b879-51e12990250a tempest-VolumesGetTest-2079832754 None] Lock "cinder-395436a4-3b3a-4b39-87e2-9087293b7166-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (f4f20ead-1545-4693-b79b-9f30082d57ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaeb4890-a352-4f58-88e3-7d4cb30e036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaeb4890-a352-4f58-88e3-7d4cb30e036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677426493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d68db5-7c3b-4c9d-bdda-fd196ffc261e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:30Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50b8819-d3e7-4f23-86b3-31f96ad20523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50b8819-d3e7-4f23-86b3-31f96ad20523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccc539e-758c-45eb-a8d2-e52c27feddcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccc539e-758c-45eb-a8d2-e52c27feddcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'volume_name': 'volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f30c7c-5aa6-4615-aad1-2a7efc6bb803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f30c7c-5aa6-4615-aad1-2a7efc6bb803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a69af5-a29e-48b2-bc55-68e37dfa7051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Volume 16d68db5-7c3b-4c9d-bdda-fd196ffc261e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'volume_size': 1} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677426493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d68db5-7c3b-4c9d-bdda-fd196ffc261e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:30Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Creating volume 16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:30 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:30 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e 1073741824 Sep 01 02:07:30 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e 1073741824" returned: 0 in 0.527s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:31 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e Sep 01 02:07:31 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a69af5-a29e-48b2-bc55-68e37dfa7051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de8cfe2-646d-4562-b9fa-ddc5f97d5c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Volume volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e (16d68db5-7c3b-4c9d-bdda-fd196ffc261e): created successfully Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de8cfe2-646d-4562-b9fa-ddc5f97d5c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (f4f20ead-1545-4693-b79b-9f30082d57ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4de98d0f-ba4e-4f95-91d6-1d34b0367419 tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Flow 'volume_create_manager' (5ac23e21-811d-404a-94a4-508681879740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c958a16-0abd-4a35-8df3-4f0c7d988896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c958a16-0abd-4a35-8df3-4f0c7d988896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2020196723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491b366d-13a1-4660-a960-2aa74bd64b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5b9ca757714edf82c429b70788f16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:32Z,use_quota=True,user_id='fabba1ff5f734a20b0d479fe2260bb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaedf8c4-6a95-4c61-84c8-8c4a267e8ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaedf8c4-6a95-4c61-84c8-8c4a267e8ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff072422-5f23-4f22-9c74-62913d45208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff072422-5f23-4f22-9c74-62913d45208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491b366d-13a1-4660-a960-2aa74bd64b66', 'volume_name': 'volume-491b366d-13a1-4660-a960-2aa74bd64b66', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd70b626-47fe-402c-8a26-9bd155c95589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd70b626-47fe-402c-8a26-9bd155c95589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0892c4-9018-4408-8436-25bcde4720f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Volume 491b366d-13a1-4660-a960-2aa74bd64b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491b366d-13a1-4660-a960-2aa74bd64b66', 'volume_size': 1} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2020196723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491b366d-13a1-4660-a960-2aa74bd64b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5b9ca757714edf82c429b70788f16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:32Z,use_quota=True,user_id='fabba1ff5f734a20b0d479fe2260bb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Creating volume 491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:31 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:31 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 1073741824 Sep 01 02:07:31 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:32 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 1073741824" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:32 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 Sep 01 02:07:32 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:33 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66" returned: 0 in 0.675s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0892c4-9018-4408-8436-25bcde4720f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491b366d-13a1-4660-a960-2aa74bd64b66', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6608c9ff-f7a8-46c8-867a-511f36d12fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Volume volume-491b366d-13a1-4660-a960-2aa74bd64b66 (491b366d-13a1-4660-a960-2aa74bd64b66): created successfully Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6608c9ff-f7a8-46c8-867a-511f36d12fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Flow 'volume_create_manager' (5ac23e21-811d-404a-94a4-508681879740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f63658d4-b52f-4d63-a581-4135ff8d4a63 tempest-TestStampPattern-722925626 None] Created volume successfully. Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (39061c7d-b295-415d-9b7d-3eaac9be3d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2667d4-3522-4f87-878e-1dc809478a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2667d4-3522-4f87-878e-1dc809478a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-407271789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb3607a-6976-483f-a03a-b17d4620e086,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=16d68db5-7c3b-4c9d-bdda-fd196ffc261e,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:33Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215f9fa-857e-4a1e-96c3-707c7408df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215f9fa-857e-4a1e-96c3-707c7408df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e14f303-b1e0-4f62-937d-3f3f03012bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e14f303-b1e0-4f62-937d-3f3f03012bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7eb3607a-6976-483f-a03a-b17d4620e086', 'volume_name': 'volume-7eb3607a-6976-483f-a03a-b17d4620e086', 'volume_size': 1, 'source_volid': '16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'source_volstatus': 'available'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154ca366-d98c-469f-a84b-a619c9425dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154ca366-d98c-469f-a84b-a619c9425dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd055a8f-9751-41cb-9315-a5febb0c3eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Volume 7eb3607a-6976-483f-a03a-b17d4620e086: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7eb3607a-6976-483f-a03a-b17d4620e086', 'volume_size': 1, 'source_volid': '16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'source_volstatus': 'available'} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:33 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Cloning volume 16d68db5-7c3b-4c9d-bdda-fd196ffc261e to volume 7eb3607a-6976-483f-a03a-b17d4620e086 Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Creating offline snapshot d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 of volume 16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46ce73f-a4d5-49ef-8a1d-0abfcdb1c3c3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:33 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e Sep 01 02:07:33 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" returned: 0 in 0.596s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:34 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 1G Sep 01 02:07:34 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 1G" returned: 0 in 0.557s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:34 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 Sep 01 02:07:34 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:35 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" returned: 0 in 0.462s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:35 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 is being set with open permissions: ugo+rw Sep 01 02:07:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 Sep 01 02:07:35 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:35 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info Sep 01 02:07:35 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:36 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info" returned: 0 in 0.331s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:36 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info is being set with open permissions: ugo+rw Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:36 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info Sep 01 02:07:36 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:36 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.info" returned: 0 in 0.326s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-7eb3607a-6976-483f-a03a-b17d4620e086" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-7eb3607a-6976-483f-a03a-b17d4620e086" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] snapshot: d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5, volume: 7eb3607a-6976-483f-a03a-b17d4620e086, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[340d099d-cb27-45e3-bf37-b57a63d385aa]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:36 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 Sep 01 02:07:36 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:37 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" returned: 0 in 0.510s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b044623-8d6e-4cfc-9ff0-e941b30b3918]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:37 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e Sep 01 02:07:37 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:37 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" returned: 0 in 0.469s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:07:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:37 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 Sep 01 02:07:37 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:40 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Flow 'volume_create_manager' (f0e5566b-a16e-460d-97dd-b7db272c5a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26ea69c-430b-4551-a8bd-c7b3307654f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26ea69c-430b-4551-a8bd-c7b3307654f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1135947548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adc6750-fabe-43e7-b073-5eb65627203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af25f6ab2cc841cd80fccce2e705b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:41Z,use_quota=True,user_id='a57f0b89490f41d6aafd362beae0e316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784f6096-7478-48ee-b088-f8d1264ef39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784f6096-7478-48ee-b088-f8d1264ef39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc74ae4-9216-41c4-82e9-77aaedecbd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc74ae4-9216-41c4-82e9-77aaedecbd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adc6750-fabe-43e7-b073-5eb65627203c', 'volume_name': 'volume-0adc6750-fabe-43e7-b073-5eb65627203c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bc661e-8f2c-44a4-a5fe-1531e2e4c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bc661e-8f2c-44a4-a5fe-1531e2e4c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce48a767-d840-4905-bbf8-52646ed18136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:41 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Volume 0adc6750-fabe-43e7-b073-5eb65627203c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adc6750-fabe-43e7-b073-5eb65627203c', 'volume_size': 1} Sep 01 02:07:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:46 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086" returned: 0 in 8.506s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:07:46 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Converted 1024.00 MB image at 120.38 MB/s Sep 01 02:07:46 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 is being set with open permissions: ugo+rw Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 Sep 01 02:07:46 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:46 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086" returned: 0 in 0.397s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-7eb3607a-6976-483f-a03a-b17d4620e086" released by "_copy_volume_from_snapshot" :: held 9.968s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Deleting offline snapshot d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 of volume 16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] snapshot_file for this snap is: volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9b26cf-453a-44dc-adee-139493719536]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Flow 'volume_create_manager' (2ee4a2aa-8cfb-4f5c-8cee-dd08df4bae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5929584-a5df-48d9-9954-20f43cd6525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5929584-a5df-48d9-9954-20f43cd6525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-808673254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da33ac40-cfa7-4a46-91b9-17a7be1c8a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ea71c43f5c4c29a8b94c4ce1fafd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:47Z,use_quota=True,user_id='b841799112ae45d09b6ff8ea294c5333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eef5ae7-702e-4754-827a-5ee33fc78b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eef5ae7-702e-4754-827a-5ee33fc78b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:46 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 Sep 01 02:07:46 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdfecb9-898f-4da2-9e50-debe36f208ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdfecb9-898f-4da2-9e50-debe36f208ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da33ac40-cfa7-4a46-91b9-17a7be1c8a24', 'volume_name': 'volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7341abe1-c721-45bd-9e51-f0d27cb18759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7341abe1-c721-45bd-9e51-f0d27cb18759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bc7ea3-30c3-4177-a122-a7d7f1abdbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:46 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Volume da33ac40-cfa7-4a46-91b9-17a7be1c8a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24', 'volume_size': 1} Sep 01 02:07:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:47 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" returned: 0 in 0.483s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:47 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9482c75-7b55-4394-acc6-93b83db5ef29]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:47 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e Sep 01 02:07:47 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:47 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" returned: 0 in 0.580s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:47 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 Sep 01 02:07:47 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" returned: 0 in 0.433s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5 Sep 01 02:07:48 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e.d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" returned: 0 in 0.320s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-d6fe9d56-f1b6-4af1-a9b2-ea7fda58a3d5" released by "_delete_snapshot" :: held 1.947s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.840s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.111s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1135947548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adc6750-fabe-43e7-b073-5eb65627203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af25f6ab2cc841cd80fccce2e705b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:41Z,use_quota=True,user_id='a57f0b89490f41d6aafd362beae0e316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Creating volume 0adc6750-fabe-43e7-b073-5eb65627203c {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:48 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c 1073741824 Sep 01 02:07:48 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd055a8f-9751-41cb-9315-a5febb0c3eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb3607a-6976-483f-a03a-b17d4620e086', 'volume_size': 1, 'source_volid': '16d68db5-7c3b-4c9d-bdda-fd196ffc261e', 'source_volstatus': 'available'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71018319-a406-47a9-97e0-83d61c22934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Volume volume-7eb3607a-6976-483f-a03a-b17d4620e086 (7eb3607a-6976-483f-a03a-b17d4620e086): created successfully Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71018319-a406-47a9-97e0-83d61c22934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (39061c7d-b295-415d-9b7d-3eaac9be3d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b2de4f1c-30ba-4114-ae93-ab888c901907 tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:07:49 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c 1073741824" returned: 0 in 0.786s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c Sep 01 02:07:49 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c" returned: 0 in 0.476s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-808673254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da33ac40-cfa7-4a46-91b9-17a7be1c8a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ea71c43f5c4c29a8b94c4ce1fafd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:47Z,use_quota=True,user_id='b841799112ae45d09b6ff8ea294c5333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Creating volume da33ac40-cfa7-4a46-91b9-17a7be1c8a24 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:49 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce48a767-d840-4905-bbf8-52646ed18136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adc6750-fabe-43e7-b073-5eb65627203c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:49 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 1073741824 Sep 01 02:07:49 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55052af0-37e4-4699-8b09-3913ac87d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Volume volume-0adc6750-fabe-43e7-b073-5eb65627203c (0adc6750-fabe-43e7-b073-5eb65627203c): created successfully Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55052af0-37e4-4699-8b09-3913ac87d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Flow 'volume_create_manager' (f0e5566b-a16e-460d-97dd-b7db272c5a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:50 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-feac8565-3707-42de-b37b-cbb4abfb5f7b tempest-AttachVolumeNegativeTest-747698300 None] Created volume successfully. Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (6597155d-70af-4c51-b28b-5db17686b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b0e171-66a8-46c5-a237-cb388b8994ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b0e171-66a8-46c5-a237-cb388b8994ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-949235601',display_name='tempest-VolumesGetTest-Volume-1129932832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd2987d-338c-4c50-9a20-f6e3e147b842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:50Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19508bc-2dc6-4c3a-8a03-b23282834462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19508bc-2dc6-4c3a-8a03-b23282834462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8640eaac-d3b3-4fb2-8860-4fa97bebf668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8640eaac-d3b3-4fb2-8860-4fa97bebf668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd2987d-338c-4c50-9a20-f6e3e147b842', 'volume_name': 'volume-abd2987d-338c-4c50-9a20-f6e3e147b842', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41da2485-a737-466c-bb72-b5020bec9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41da2485-a737-466c-bb72-b5020bec9aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e77aae-7aea-4f99-b479-c63daefc9a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Volume abd2987d-338c-4c50-9a20-f6e3e147b842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd2987d-338c-4c50-9a20-f6e3e147b842', 'volume_size': 1} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:50 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 1073741824" returned: 0 in 0.885s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 Sep 01 02:07:50 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:51 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24" returned: 0 in 0.482s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-949235601',display_name='tempest-VolumesGetTest-Volume-1129932832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd2987d-338c-4c50-9a20-f6e3e147b842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:50Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Creating volume abd2987d-338c-4c50-9a20-f6e3e147b842 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:51 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bc7ea3-30c3-4177-a122-a7d7f1abdbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd0f277-be25-4fdb-a3d6-6bb8cc686544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:51 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 1073741824 Sep 01 02:07:51 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:51 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Volume volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 (da33ac40-cfa7-4a46-91b9-17a7be1c8a24): created successfully Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd0f277-be25-4fdb-a3d6-6bb8cc686544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Flow 'volume_create_manager' (2ee4a2aa-8cfb-4f5c-8cee-dd08df4bae9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b9ced2fd-d1e3-43b2-a213-deb37c8854db tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Created volume successfully. Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-078fdbf8-8543-4764-85eb-2cdb04992d7b req-49111c4d-2aaa-4d6d-83ba-ba5bbee397e5 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:51 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 1073741824" returned: 0 in 0.526s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 Sep 01 02:07:51 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-078fdbf8-8543-4764-85eb-2cdb04992d7b req-49111c4d-2aaa-4d6d-83ba-ba5bbee397e5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.743s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e77aae-7aea-4f99-b479-c63daefc9a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd2987d-338c-4c50-9a20-f6e3e147b842', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0fdf54-1e16-4475-bf8e-71539c84182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-078fdbf8-8543-4764-85eb-2cdb04992d7b req-49111c4d-2aaa-4d6d-83ba-ba5bbee397e5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:52 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Volume volume-abd2987d-338c-4c50-9a20-f6e3e147b842 (abd2987d-338c-4c50-9a20-f6e3e147b842): created successfully Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0fdf54-1e16-4475-bf8e-71539c84182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (6597155d-70af-4c51-b28b-5db17686b695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-781e2629-b5a5-4e28-a338-4f3be9452d1f tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-078fdbf8-8543-4764-85eb-2cdb04992d7b req-49111c4d-2aaa-4d6d-83ba-ba5bbee397e5 tempest-AttachVolumeNegativeTest-747698300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-0adc6750-fabe-43e7-b073-5eb65627203c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4d1dcea-2a4e-4124-b181-c1efb5b59749', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:07:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-078fdbf8-8543-4764-85eb-2cdb04992d7b req-49111c4d-2aaa-4d6d-83ba-ba5bbee397e5 tempest-AttachVolumeNegativeTest-747698300 None] attachment_update completed successfully. Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-abd2987d-338c-4c50-9a20-f6e3e147b842-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Lock "cinder-abd2987d-338c-4c50-9a20-f6e3e147b842-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-abd2987d-338c-4c50-9a20-f6e3e147b842" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-abd2987d-338c-4c50-9a20-f6e3e147b842" acquired by "delete_volume" :: waited 0.049s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ef3470-b196-4146-8cb8-3d7e609c0d54]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:53 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 Sep 01 02:07:53 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:53 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842" returned: 0 in 0.630s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:53 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842 Sep 01 02:07:53 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Acquiring lock "cinder-da33ac40-cfa7-4a46-91b9-17a7be1c8a24-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "cinder-da33ac40-cfa7-4a46-91b9-17a7be1c8a24-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Acquiring lock "cinder-quobyte-da33ac40-cfa7-4a46-91b9-17a7be1c8a24" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "cinder-quobyte-da33ac40-cfa7-4a46-91b9-17a7be1c8a24" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aaefdb-f07d-4d1a-81b5-94726c62a29f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:54 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-abd2987d-338c-4c50-9a20-f6e3e147b842" returned: 0 in 0.485s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-abd2987d-338c-4c50-9a20-f6e3e147b842" released by "delete_volume" :: held 1.183s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:54 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 Sep 01 02:07:54 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Created reservations ['bb6a912a-5f93-4fdb-ac4f-4554754df2c4', 'e9f218a8-ec17-4af5-b9d3-c48109873834', '0e883f9c-6265-468f-a7d0-2089171fd30d', '313a75ce-a909-41b2-8fa7-581e32015cac'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:54 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:54 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:54 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24" returned: 0 in 0.402s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:54 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24 Sep 01 02:07:54 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:54 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.278s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ab5b171a-9b78-4685-b03b-e4a8a324463d tempest-VolumesGetTest-2079832754 None] Lock "cinder-abd2987d-338c-4c50-9a20-f6e3e147b842-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:54 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-da33ac40-cfa7-4a46-91b9-17a7be1c8a24" returned: 0 in 0.305s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "cinder-quobyte-da33ac40-cfa7-4a46-91b9-17a7be1c8a24" released by "delete_volume" :: held 0.755s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=70,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Created reservations ['9a014885-f5d2-4a55-845e-2cbd47e169b3', '0df8d51b-9104-4a41-bd85-3e7bd90d1fbd', 'f187513c-e1df-4230-9ee3-08a865cf64a3', '0141cf81-405a-4907-a6ce-cd388ba57415'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:55 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:55 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:55 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.302s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Deleted volume successfully. Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-20cc05d7-b517-431c-9061-1867610f9215 tempest-VolumeQuotasNegativeTestJSON-1141092968 None] Lock "cinder-da33ac40-cfa7-4a46-91b9-17a7be1c8a24-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-7eb3607a-6976-483f-a03a-b17d4620e086-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Lock "cinder-7eb3607a-6976-483f-a03a-b17d4620e086-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-7eb3607a-6976-483f-a03a-b17d4620e086" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-7eb3607a-6976-483f-a03a-b17d4620e086" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3baf3f-de74-4cef-822f-726e45893fe2]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-7401374d-da74-40a3-837a-63c9915b2f04 req-40c0771c-3278-42f0-8d65-f28e1ec3a052 tempest-AttachVolumeNegativeTest-747698300 None] Terminate volume connection completed successfully. Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-7401374d-da74-40a3-837a-63c9915b2f04 req-40c0771c-3278-42f0-8d65-f28e1ec3a052 tempest-AttachVolumeNegativeTest-747698300 None] Deleting attachment b4d1dcea-2a4e-4124-b181-c1efb5b59749. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:07:55 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 Sep 01 02:07:55 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:55 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086" returned: 0 in 0.462s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:56 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086 Sep 01 02:07:56 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:56 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7eb3607a-6976-483f-a03a-b17d4620e086" returned: 0 in 0.317s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-7eb3607a-6976-483f-a03a-b17d4620e086" released by "delete_volume" :: held 0.827s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Created reservations ['40680cc5-d4f1-4f6a-8d47-ee2b549f05b2', 'b9fbdb99-6aac-40f9-808a-4a3db79bbce6', 'fbd402e3-c083-4250-a578-3db43ae5ea41', 'b747eafc-22b7-46af-a71d-8725bf8f6baa'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:56 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:56 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-16d68db5-7c3b-4c9d-bdda-fd196ffc261e-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Lock "cinder-16d68db5-7c3b-4c9d-bdda-fd196ffc261e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:56 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.579s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c6070-8f73-486c-a2df-49c90b7f3a0c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-98392ffb-6a10-415c-8430-1b7efd8e8d96 tempest-VolumesGetTest-2079832754 None] Lock "cinder-7eb3607a-6976-483f-a03a-b17d4620e086-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:57 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e Sep 01 02:07:57 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:57 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" returned: 0 in 0.525s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:57 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e Sep 01 02:07:57 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:58 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" returned: 0 in 0.436s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-16d68db5-7c3b-4c9d-bdda-fd196ffc261e" released by "delete_volume" :: held 1.182s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Created reservations ['a39fe307-3e1e-48e3-82da-526b74232e1d', '5d5472d0-d50b-4f4f-ac9e-8c5d31f7a200', 'b14d0a6d-0ac1-4767-8698-481afbe59c9f', '160dd8fd-2025-4ab2-b7e3-3aa7f49afe5a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:58 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:07:58 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:58 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.290s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:07:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dbc69ddf-9961-40a2-bf31-03d5e09be927 tempest-VolumesGetTest-2079832754 None] Lock "cinder-16d68db5-7c3b-4c9d-bdda-fd196ffc261e-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (3d81c746-fb1c-40f1-8c74-e80fcb12962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ec761a-e07b-4933-8203-c3c8bb46e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ec761a-e07b-4933-8203-c3c8bb46e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519757880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2f1102-bfae-4db9-85c1-efacfa9f5500,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:01Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fefd0e3-aa98-4c26-8edd-755ee5d65de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fefd0e3-aa98-4c26-8edd-755ee5d65de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a12624c-62b3-45ef-a516-bf719a87d112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a12624c-62b3-45ef-a516-bf719a87d112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f2f1102-bfae-4db9-85c1-efacfa9f5500', 'volume_name': 'volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1926ec04-1b13-490e-8889-a95af2d15a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1926ec04-1b13-490e-8889-a95af2d15a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d82405f-bf82-4fd9-9488-fc70c893833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Volume 0f2f1102-bfae-4db9-85c1-efacfa9f5500: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:08:01 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Trying to clone 0f2f1102-bfae-4db9-85c1-efacfa9f5500 from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:08:02 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf24740-6d8b-4c5f-8edc-6b374af1f8d6]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:02 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD Sep 01 02:08:02 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:02 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 is fetched for user ed63c87967514395b295f0a3c0ee73fd. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b230231d-d186-4a70-9bcf-1064c58c0a0a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:03 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD Sep 01 02:08:03 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:03 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519757880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2f1102-bfae-4db9-85c1-efacfa9f5500,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:01Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Creating volume 0f2f1102-bfae-4db9-85c1-efacfa9f5500 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:03 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:03 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 1073741824 Sep 01 02:08:03 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Flow 'volume_create_manager' (f056367b-7430-4acc-9c93-8e24546a623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef876f57-eb21-45fa-b036-6b6349f7c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef876f57-eb21-45fa-b036-6b6349f7c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2042924479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec138c1-75a7-4599-855f-924d4b27f361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de52585dbf04621b1be45bdc9959a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:04Z,use_quota=True,user_id='928803e8aa194199a3626a9b77b6aa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25287127-c5bb-4c15-86a4-cc223c5037aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25287127-c5bb-4c15-86a4-cc223c5037aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2bb57d-7f39-400c-9a80-87f4a55230f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2bb57d-7f39-400c-9a80-87f4a55230f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec138c1-75a7-4599-855f-924d4b27f361', 'volume_name': 'volume-8ec138c1-75a7-4599-855f-924d4b27f361', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17038a51-afaf-495e-9308-ef3269d6e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17038a51-afaf-495e-9308-ef3269d6e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dd4995-e363-44cc-8575-95803d998628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:03 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Volume 8ec138c1-75a7-4599-855f-924d4b27f361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec138c1-75a7-4599-855f-924d4b27f361', 'volume_size': 1} Sep 01 02:08:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:04 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 1073741824" returned: 0 in 0.631s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 Sep 01 02:08:04 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2042924479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec138c1-75a7-4599-855f-924d4b27f361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de52585dbf04621b1be45bdc9959a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:04Z,use_quota=True,user_id='928803e8aa194199a3626a9b77b6aa98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Creating volume 8ec138c1-75a7-4599-855f-924d4b27f361 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:04 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 1073741824 Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Attempting download of d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume 0f2f1102-bfae-4db9-85c1-efacfa9f5500. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:08:04 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f7b8dc-c427-4ca9-96a9-3db56d3510d1]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03 Sep 01 02:08:04 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-545f648f-0ff1-4830-a3a2-89ecfa9ffebe req-875083e8-faa1-4f78-919b-8b479db507ad tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:05 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:05 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 1073741824" returned: 0 in 0.637s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:05 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03 Sep 01 02:08:05 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:05 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 Sep 01 02:08:05 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:05 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03" returned: 1 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_7x1x5b03' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1866022b-79fa-4b15-8cbc-05631274fb43]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:05 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-545f648f-0ff1-4830-a3a2-89ecfa9ffebe req-875083e8-faa1-4f78-919b-8b479db507ad tempest-TestStampPattern-722925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.579s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dd4995-e363-44cc-8575-95803d998628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec138c1-75a7-4599-855f-924d4b27f361', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f675835-871b-4fa3-a5a4-e3c8a0abc85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-545f648f-0ff1-4830-a3a2-89ecfa9ffebe req-875083e8-faa1-4f78-919b-8b479db507ad tempest-TestStampPattern-722925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:05 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Volume volume-8ec138c1-75a7-4599-855f-924d4b27f361 (8ec138c1-75a7-4599-855f-924d4b27f361): created successfully Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f675835-871b-4fa3-a5a4-e3c8a0abc85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Flow 'volume_create_manager' (f056367b-7430-4acc-9c93-8e24546a623e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:05 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD Sep 01 02:08:05 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e97b6231-2d4f-4cec-886e-b19320f57a6e tempest-VolumesServicesTestJSON-1900789937 None] Created volume successfully. Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-545f648f-0ff1-4830-a3a2-89ecfa9ffebe req-875083e8-faa1-4f78-919b-8b479db507ad tempest-TestStampPattern-722925626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-491b366d-13a1-4660-a960-2aa74bd64b66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a412344-b3f6-4f94-b296-0fbd61aa1e2d', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-545f648f-0ff1-4830-a3a2-89ecfa9ffebe req-875083e8-faa1-4f78-919b-8b479db507ad tempest-TestStampPattern-722925626 None] attachment_update completed successfully. Sep 01 02:08:05 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 was qcow2, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:08:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:05 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 Sep 01 02:08:05 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Acquiring lock "cinder-8ec138c1-75a7-4599-855f-924d4b27f361-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Lock "cinder-8ec138c1-75a7-4599-855f-924d4b27f361-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Acquiring lock "cinder-quobyte-8ec138c1-75a7-4599-855f-924d4b27f361" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Lock "cinder-quobyte-8ec138c1-75a7-4599-855f-924d4b27f361" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e364f0c5-d7c0-4e23-94d0-7a59060b6921]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:06 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 Sep 01 02:08:06 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:06 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361" returned: 0 in 0.474s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:06 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361 Sep 01 02:08:06 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:07 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8ec138c1-75a7-4599-855f-924d4b27f361" returned: 0 in 0.342s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Lock "cinder-quobyte-8ec138c1-75a7-4599-855f-924d4b27f361" released by "delete_volume" :: held 0.896s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Created reservations ['79c47f95-c4cd-4695-9091-d656ba3cc2bd', '44b5badc-8175-4ea5-813d-5957eec125df', 'f4c05d8b-debc-47f3-9694-c7e769a1c7f6', '624c3ca5-a153-4251-83ea-3e2dc1b9074b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:07 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:07 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:07 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.458s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Deleted volume successfully. Sep 01 02:08:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0d279615-ff10-4eb9-8ff1-b11abf00e474 tempest-VolumesServicesTestJSON-1900789937 None] Lock "cinder-8ec138c1-75a7-4599-855f-924d4b27f361-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:08 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500" returned: 0 in 2.667s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:08 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_g5go9ey3devstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:08 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Converted 112.00 MB image at 41.94 MB/s Sep 01 02:08:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:08 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 1G Sep 01 02:08:08 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:09 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 1G" returned: 0 in 0.571s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Downloaded image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume 0f2f1102-bfae-4db9-85c1-efacfa9f5500 successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 for user ed63c87967514395b295f0a3c0ee73fd is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Marking volume 0f2f1102-bfae-4db9-85c1-efacfa9f5500 as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Copying metadata from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 to 0f2f1102-bfae-4db9-85c1-efacfa9f5500. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Creating volume glance metadata for volume 0f2f1102-bfae-4db9-85c1-efacfa9f5500 backed by image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d82405f-bf82-4fd9-9488-fc70c893833b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8552bbd-d7ee-4a04-a5d2-8d599bffb0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=98,cinder:UPDATE=106,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:09 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Volume volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 (0f2f1102-bfae-4db9-85c1-efacfa9f5500): created successfully Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8552bbd-d7ee-4a04-a5d2-8d599bffb0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (3d81c746-fb1c-40f1-8c74-e80fcb12962a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c7cddcb7-3f01-45e7-ba08-50f3eb828cd3 tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (489def71-5391-4550-a3a9-3f1528f19a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68c4ce2-c122-404f-b3c9-7f09ce4fd7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68c4ce2-c122-404f-b3c9-7f09ce4fd7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1319856601',display_name='tempest-VolumesGetTest-Volume-192550871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:11Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d76750e-1c22-407d-8a61-0a086daa7b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d76750e-1c22-407d-8a61-0a086daa7b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34c151d-a906-46fb-9fbb-acd3fcdfbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34c151d-a906-46fb-9fbb-acd3fcdfbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0', 'volume_name': 'volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd99842-011f-4505-88cd-6d8af3f70276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd99842-011f-4505-88cd-6d8af3f70276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3e35f2-81e4-445a-a9f1-2a4611d2b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Volume f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0', 'volume_size': 1} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1319856601',display_name='tempest-VolumesGetTest-Volume-192550871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f77602e5704fb3a001f3b26d9cd8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:11Z,use_quota=True,user_id='ed63c87967514395b295f0a3c0ee73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Creating volume f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:11 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:11 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 1073741824 Sep 01 02:08:11 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:11 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:11 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-ae19876f-cbee-401d-9f7a-07d77f501bb1 req-3dfd5807-2e5e-4aee-8b2e-fba179c040e5 tempest-TestStampPattern-722925626 None] Terminate volume connection completed successfully. Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-ae19876f-cbee-401d-9f7a-07d77f501bb1 req-3dfd5807-2e5e-4aee-8b2e-fba179c040e5 tempest-TestStampPattern-722925626 None] Deleting attachment 9a412344-b3f6-4f94-b296-0fbd61aa1e2d. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 1073741824" returned: 0 in 0.694s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:11 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 Sep 01 02:08:11 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:12 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0" returned: 0 in 0.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3e35f2-81e4-445a-a9f1-2a4611d2b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b520512f-e846-4d4f-8c57-2b9027a3c605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:12 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Volume volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 (f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0): created successfully Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b520512f-e846-4d4f-8c57-2b9027a3c605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Flow 'volume_create_manager' (489def71-5391-4550-a3a9-3f1528f19a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5b5d8c8a-5058-4817-8049-dd5add453154 tempest-VolumesGetTest-2079832754 None] Created volume successfully. Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Creating offline snapshot f658f220-1dd7-4140-8340-c3d1f59e4b6f of volume 491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dffea6-8014-4c33-8e89-80aaac2d8473]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 Sep 01 02:08:12 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Lock "cinder-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:13 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66" returned: 0 in 0.658s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:13 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f 1G Sep 01 02:08:13 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86c97a-6f88-4448-bc4a-2d802a54ea32]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:13 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 Sep 01 02:08:13 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f 1G" returned: 0 in 0.881s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491b366d-13a1-4660-a960-2aa74bd64b66 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0" returned: 0 in 0.776s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491b366d-13a1-4660-a960-2aa74bd64b66 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f Sep 01 02:08:14 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0 Sep 01 02:08:14 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491b366d-13a1-4660-a960-2aa74bd64b66 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f" returned: 0 in 0.703s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:15 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f is being set with open permissions: ugo+rw Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:15 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f Sep 01 02:08:15 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:15 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0" returned: 0 in 0.761s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0" released by "delete_volume" :: held 1.620s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Created reservations ['8b4229b6-f4bf-4926-86e4-f76c07b9b92a', '05b25706-05d1-40e0-b8ce-fc782f5d998d', '0ec94274-213b-48e1-923a-44abc0c8b3ae', '9765aa27-6222-49d8-9cdd-11b0384aafa5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:15 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:15 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:15 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f" returned: 0 in 0.531s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:15 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info Sep 01 02:08:15 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:15 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.540s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-0f2f1102-bfae-4db9-85c1-efacfa9f5500-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Lock "cinder-0f2f1102-bfae-4db9-85c1-efacfa9f5500-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8dcbb27-1a61-4ca7-80a0-fd7dd5cd3653 tempest-VolumesGetTest-2079832754 None] Lock "cinder-f9915c5e-8e40-4bb2-9a6a-a15e5aa71bd0-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Acquiring lock "cinder-quobyte-0f2f1102-bfae-4db9-85c1-efacfa9f5500" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-0f2f1102-bfae-4db9-85c1-efacfa9f5500" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:16 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info" returned: 0 in 0.662s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:16 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info is being set with open permissions: ugo+rw Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60f97a9-12c7-4527-8174-d7c7e9c72047]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:16 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info Sep 01 02:08:16 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:16 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 Sep 01 02:08:16 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:16 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.info" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.902s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-aed29aa0-15db-4b5a-8fc8-2a2d3b8bb7f1 tempest-TestStampPattern-722925626 None] Create snapshot completed successfully Sep 01 02:08:16 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500" returned: 0 in 0.504s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:16 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500 Sep 01 02:08:16 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Flow 'volume_create_manager' (e9bec19b-6ba0-4e3e-855a-385148dee1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc99af59-a70d-4c73-aa8c-70c2c98986f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0f2f1102-bfae-4db9-85c1-efacfa9f5500" returned: 0 in 0.538s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Lock "cinder-quobyte-0f2f1102-bfae-4db9-85c1-efacfa9f5500" released by "delete_volume" :: held 1.117s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc99af59-a70d-4c73-aa8c-70c2c98986f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1745575377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a5ed77e70649b18418005b55e4cfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:17Z,use_quota=True,user_id='98df33b776d6404780521b1405283931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b44f3af-52b4-4604-854c-f1fc3683474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b44f3af-52b4-4604-854c-f1fc3683474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847d77cc-c88b-45bf-b915-b7f6145b459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847d77cc-c88b-45bf-b915-b7f6145b459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592', 'volume_name': 'volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7709eb6f-1563-430d-8fda-9224c38ff624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7709eb6f-1563-430d-8fda-9224c38ff624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e19dc9-b294-4ebe-b64f-8927b18aed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Volume 502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592', 'volume_size': 1} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1745575377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a5ed77e70649b18418005b55e4cfb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:17Z,use_quota=True,user_id='98df33b776d6404780521b1405283931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Creating volume 502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:17 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 1073741824 Sep 01 02:08:17 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Created reservations ['ab0be415-d589-4526-8f27-6ccdbd540938', '0a4d6d3e-2edd-4831-a045-501b5e20ead3', 'c918d099-ff9d-4df4-bb66-6b36a07e4099', 'c0187d03-9df1-4a5f-bb8f-8362b5394ccc'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:17 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:18 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.370s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Deleted volume successfully. Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-51ec8f1e-00f7-45a2-981b-bf3a92d22bde tempest-VolumesGetTest-2079832754 None] Lock "cinder-0f2f1102-bfae-4db9-85c1-efacfa9f5500-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:18 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 1073741824" returned: 0 in 0.808s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:18 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 Sep 01 02:08:18 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:18 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" returned: 0 in 0.561s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e19dc9-b294-4ebe-b64f-8927b18aed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d38d82a-eba8-41f4-b5ce-43616aea7237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Volume volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 (502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592): created successfully Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d38d82a-eba8-41f4-b5ce-43616aea7237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Flow 'volume_create_manager' (e9bec19b-6ba0-4e3e-855a-385148dee1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:19 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2cc9ca1f-4db1-496a-8dbe-8e9d94e06dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Created volume successfully. Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Creating offline snapshot 66aedc03-ade3-4399-b842-9c598ebb3412 of volume 502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3ffdb-2eee-48db-b066-b089064dd6bd]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 Sep 01 02:08:20 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:20 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" returned: 0 in 0.714s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:20 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 1G Sep 01 02:08:20 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 1G" returned: 0 in 0.633s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 Sep 01 02:08:21 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412" returned: 0 in 0.326s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 is being set with open permissions: ugo+rw Sep 01 02:08:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 Sep 01 02:08:21 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info Sep 01 02:08:22 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info is being set with open permissions: ugo+rw Sep 01 02:08:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info Sep 01 02:08:22 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.info" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:22 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9e8e0a80-8900-452d-a684-f87e437d29be tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Create snapshot completed successfully Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Flow 'volume_create_manager' (da84bffa-8069-4970-acb6-0aefd21e68c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987cad7e-9047-4c85-b3da-34b99f2c2fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "cinder-66aedc03-ade3-4399-b842-9c598ebb3412-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987cad7e-9047-4c85-b3da-34b99f2c2fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1095127292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f929c6b4-850d-4acb-8587-6f3b07f9ef60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb519c895b843299cf68e2b1ba218c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:24Z,use_quota=True,user_id='18c8b8cddd7c4ebeb3094bbed08c3880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6f3c82-3db2-49d5-b4d7-d876b477b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6f3c82-3db2-49d5-b4d7-d876b477b354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f7bbc1-fa23-41cc-bed9-eaf668179382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f7bbc1-fa23-41cc-bed9-eaf668179382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f929c6b4-850d-4acb-8587-6f3b07f9ef60', 'volume_name': 'volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60', 'volume_size': 2}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8664976-2df2-472d-be77-26e9fef82149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8664976-2df2-472d-be77-26e9fef82149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e8e253-9ff9-4ebb-b7f9-051cbcac6cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Volume f929c6b4-850d-4acb-8587-6f3b07f9ef60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60', 'volume_size': 2} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1095127292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f929c6b4-850d-4acb-8587-6f3b07f9ef60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb519c895b843299cf68e2b1ba218c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:24Z,use_quota=True,user_id='18c8b8cddd7c4ebeb3094bbed08c3880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Creating volume f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:23 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 2147483648 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-66aedc03-ade3-4399-b842-9c598ebb3412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.114s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "cinder-quobyte-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:23 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 2147483648 Sep 01 02:08:23 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-quobyte-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "cinder-quobyte-66aedc03-ade3-4399-b842-9c598ebb3412" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-quobyte-66aedc03-ade3-4399-b842-9c598ebb3412" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Deleting offline snapshot 66aedc03-ade3-4399-b842-9c598ebb3412 of volume 502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] snapshot_file for this snap is: volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b253b7-447f-4594-ab33-20ce8dd2bf10]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:23 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 Sep 01 02:08:23 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412" returned: 0 in 0.477s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:24 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 2147483648" returned: 0 in 0.622s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad36105-125c-45e2-82bd-f3107e5380b4]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 Sep 01 02:08:24 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 Sep 01 02:08:24 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60" returned: 0 in 0.345s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e8e253-9ff9-4ebb-b7f9-051cbcac6cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60', 'volume_size': 2}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4528c292-b79f-4221-820a-3516fe701227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Volume volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 (f929c6b4-850d-4acb-8587-6f3b07f9ef60): created successfully Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4528c292-b79f-4221-820a-3516fe701227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Flow 'volume_create_manager' (da84bffa-8069-4970-acb6-0aefd21e68c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-02dc5632-f2c1-45d3-9f15-236813e0236b tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Created volume successfully. Sep 01 02:08:24 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" returned: 0 in 0.561s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 Sep 01 02:08:24 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:25 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412" returned: 0 in 0.415s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:25 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412 Sep 01 02:08:25 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:25 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592.66aedc03-ade3-4399-b842-9c598ebb3412" returned: 0 in 0.391s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-quobyte-66aedc03-ade3-4399-b842-9c598ebb3412" released by "_delete_snapshot" :: held 2.003s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-quobyte-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" released by "delete_snapshot" :: held 2.041s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Created reservations ['b6ba4ed6-2541-443d-87e9-95a0f394757f', 'e854a023-26af-4b0e-8cb4-75860ab4fec7', 'e90cf246-8467-4ae5-8e20-7ba11f943159', 'c855394f-3b99-44ad-a302-90a90d64eeea'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Creating offline snapshot 89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 of volume f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ec636c-6c0a-4d8d-b8b8-015fa18b6734]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Delete snapshot completed successfully. Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-762e0879-403f-4fbc-b92b-41039fa35c8d tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-66aedc03-ade3-4399-b842-9c598ebb3412-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:26 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 Sep 01 02:08:26 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:26 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60" returned: 0 in 0.401s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 2G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 2G Sep 01 02:08:26 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:26 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 2G" returned: 0 in 0.413s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 Sep 01 02:08:26 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "cinder-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "cinder-quobyte-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-quobyte-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d1fd0-641c-410b-a700-ecfa4246a165]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:27 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" returned: 0 in 0.476s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 is being set with open permissions: ugo+rw Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:27 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 Sep 01 02:08:27 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 Sep 01 02:08:27 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" returned: 0 in 0.426s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:27 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592 Sep 01 02:08:27 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:27 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" returned: 0 in 0.497s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Flow 'volume_create_manager' (56a50e57-127b-44f0-badf-82b6c8df1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d1ff02-1762-454d-aa89-c12a0d259fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d1ff02-1762-454d-aa89-c12a0d259fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-409847019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008cc174-ff3a-4cda-a4df-f8c28d79e845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5b9ca757714edf82c429b70788f16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f658f220-1dd7-4140-8340-c3d1f59e4b6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:28Z,use_quota=True,user_id='fabba1ff5f734a20b0d479fe2260bb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e837a352-b0da-4c05-8978-f32081c9bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e837a352-b0da-4c05-8978-f32081c9bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a4e83-9b8a-4827-b2af-6d58ab697afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a4e83-9b8a-4827-b2af-6d58ab697afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '008cc174-ff3a-4cda-a4df-f8c28d79e845', 'volume_name': 'volume-008cc174-ff3a-4cda-a4df-f8c28d79e845', 'volume_size': 1, 'snapshot_id': 'f658f220-1dd7-4140-8340-c3d1f59e4b6f'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcb55ce-d165-4f8d-b531-8a81a2a90d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcb55ce-d165-4f8d-b531-8a81a2a90d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdddf50d-46bf-4301-87f9-680310f8411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:27 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Volume 008cc174-ff3a-4cda-a4df-f8c28d79e845: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-008cc174-ff3a-4cda-a4df-f8c28d79e845', 'volume_size': 1, 'snapshot_id': 'f658f220-1dd7-4140-8340-c3d1f59e4b6f'} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info Sep 01 02:08:28 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" returned: 0 in 0.448s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-quobyte-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592" released by "delete_volume" :: held 0.964s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Created reservations ['8328db47-a3ff-4dac-a0f4-275e73b7c43d', '20ce3133-3617-451f-8467-5000786bf068', 'facd9c63-118a-493e-b3e8-957e2b87c2e2', 'f9b0c445-f670-4485-8231-14949a5c3d78'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:28 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info" returned: 0 in 0.445s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info is being set with open permissions: ugo+rw Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info Sep 01 02:08:28 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:28 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:28 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:28 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.info" returned: 0 in 0.395s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:28 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.911s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-quobyte-f658f220-1dd7-4140-8340-c3d1f59e4b6f-008cc174-ff3a-4cda-a4df-f8c28d79e845" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.391s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Deleted volume successfully. Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-f658f220-1dd7-4140-8340-c3d1f59e4b6f-008cc174-ff3a-4cda-a4df-f8c28d79e845" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Creating volume 008cc174-ff3a-4cda-a4df-f8c28d79e845 from snapshot f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-quobyte-008cc174-ff3a-4cda-a4df-f8c28d79e845" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-86be8177-3b55-49ec-9992-edb20cab6e5a tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Create snapshot completed successfully Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-008cc174-ff3a-4cda-a4df-f8c28d79e845" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] snapshot: f658f220-1dd7-4140-8340-c3d1f59e4b6f, volume: 008cc174-ff3a-4cda-a4df-f8c28d79e845, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:08:28 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5d2a0f75-51e4-4904-962a-e81cff9565a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1019772552 None] Lock "cinder-502a6fa1-4822-4a3f-bcc6-ae5ab5a3f592-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.473s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40e9d22-4c44-47b6-babc-c4bd2900c571]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:29 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f Sep 01 02:08:29 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "cinder-89a72e7d-bb1f-4fb3-9b76-bf30f91b2507-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-89a72e7d-bb1f-4fb3-9b76-bf30f91b2507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "cinder-quobyte-f929c6b4-850d-4acb-8587-6f3b07f9ef60" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-quobyte-f929c6b4-850d-4acb-8587-6f3b07f9ef60" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "cinder-quobyte-89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-quobyte-89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Deleting offline snapshot 89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 of volume f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] snapshot_file for this snap is: volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c476870-ffe0-46f6-b4f9-03c1a4e57b07]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:29 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 Sep 01 02:08:29 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f" returned: 0 in 0.562s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-491b366d-13a1-4660-a960-2aa74bd64b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8464453-d99f-4401-b4b4-902020ecb785]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:29 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 Sep 01 02:08:29 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" returned: 0 in 0.514s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[933debb3-5011-472a-98eb-9399ba469930]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:30 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66" returned: 0 in 0.498s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:08:30 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 Sep 01 02:08:30 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:30 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 Sep 01 02:08:30 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:30 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60" returned: 0 in 0.528s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:30 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 Sep 01 02:08:30 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:31 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" returned: 0 in 0.632s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:31 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507 Sep 01 02:08:31 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:31 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60.89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" returned: 0 in 0.655s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-quobyte-89a72e7d-bb1f-4fb3-9b76-bf30f91b2507" released by "_delete_snapshot" :: held 2.537s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-quobyte-f929c6b4-850d-4acb-8587-6f3b07f9ef60" released by "delete_snapshot" :: held 2.580s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:32 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Created reservations ['0f3a0106-c89b-4cd7-9bca-df6e5ad27b8f', '2e83afeb-a275-4ed9-92a8-4d94514f58bd', '4f21d256-5b5c-4259-b9d4-00bb9ee0f8e4', 'f6fee5db-0588-4fbf-afe5-548a5bd73f00'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Delete snapshot completed successfully. Sep 01 02:08:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6bb36746-dc1c-46ff-95cf-b7045bd868d7 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-89a72e7d-bb1f-4fb3-9b76-bf30f91b2507-delete_snapshot" released by "delete_snapshot" :: held 3.034s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "cinder-f929c6b4-850d-4acb-8587-6f3b07f9ef60-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-f929c6b4-850d-4acb-8587-6f3b07f9ef60-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "cinder-quobyte-f929c6b4-850d-4acb-8587-6f3b07f9ef60" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-quobyte-f929c6b4-850d-4acb-8587-6f3b07f9ef60" acquired by "delete_volume" :: waited 0.054s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de10432-7692-4aa5-b004-756421f95a94]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 Sep 01 02:08:33 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:34 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60" returned: 0 in 1.190s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:34 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60 Sep 01 02:08:34 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:35 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f929c6b4-850d-4acb-8587-6f3b07f9ef60" returned: 0 in 0.960s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-quobyte-f929c6b4-850d-4acb-8587-6f3b07f9ef60" released by "delete_volume" :: held 2.373s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:35 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Created reservations ['a482478e-4a15-4c8e-9608-1bb644b85ff0', '56a5be9a-1fb3-4121-9412-dadaf6d63689', 'c8a24b1f-eee8-443a-9189-d9ed18135cdd', '95f1dedf-c49e-4ec9-9063-a4e9fb35914c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:36 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:36 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:37 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 1.040s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Deleted volume successfully. Sep 01 02:08:37 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845" returned: 0 in 7.067s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:37 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Converted 1024.00 MB image at 144.86 MB/s Sep 01 02:08:37 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 is being set with open permissions: ugo+rw Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-784359f6-c0a5-4523-b338-8b7c026487b5 tempest-VolumesSnapshotNegativeTestJSON-903863352 None] Lock "cinder-f929c6b4-850d-4acb-8587-6f3b07f9ef60-delete_volume" released by "delete_volume" :: held 4.097s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:37 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 Sep 01 02:08:37 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:37 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845" returned: 0 in 0.543s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-008cc174-ff3a-4cda-a4df-f8c28d79e845" released by "_copy_volume_from_snapshot" :: held 8.799s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-f658f220-1dd7-4140-8340-c3d1f59e4b6f-008cc174-ff3a-4cda-a4df-f8c28d79e845" released by "_create_volume_from_snapshot" :: held 8.942s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdddf50d-46bf-4301-87f9-680310f8411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008cc174-ff3a-4cda-a4df-f8c28d79e845', 'volume_size': 1, 'snapshot_id': 'f658f220-1dd7-4140-8340-c3d1f59e4b6f'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6ea57-49b9-4a61-838a-c4ffd1f4f349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:37 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Volume volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 (008cc174-ff3a-4cda-a4df-f8c28d79e845): created successfully Sep 01 02:08:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6ea57-49b9-4a61-838a-c4ffd1f4f349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Flow 'volume_create_manager' (56a50e57-127b-44f0-badf-82b6c8df1e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c735d7c7-4c3b-4b4a-93f8-1cbcb0dea426 tempest-TestStampPattern-722925626 None] Created volume successfully. Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Flow 'volume_create_manager' (7703eea6-0c65-46bf-92f0-28c8017600e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3501bc5a-95bf-4b71-84b0-b2e79e65b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3501bc5a-95bf-4b71-84b0-b2e79e65b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-404751872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd7ccda-226a-4a9a-905c-ff3de20d1be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af25f6ab2cc841cd80fccce2e705b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:42Z,use_quota=True,user_id='a57f0b89490f41d6aafd362beae0e316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465df602-c5d6-495c-aed5-83d70fb99061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465df602-c5d6-495c-aed5-83d70fb99061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7a3bf8-569d-4c23-bf26-dbc0210d0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7a3bf8-569d-4c23-bf26-dbc0210d0405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd7ccda-226a-4a9a-905c-ff3de20d1be7', 'volume_name': 'volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6448acc0-a891-43b6-9e0b-b956f01ff3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6448acc0-a891-43b6-9e0b-b956f01ff3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330cb9bf-0b70-4ace-a9c0-6babd362ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Volume cbd7ccda-226a-4a9a-905c-ff3de20d1be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7', 'volume_size': 1} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-404751872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd7ccda-226a-4a9a-905c-ff3de20d1be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af25f6ab2cc841cd80fccce2e705b381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:42Z,use_quota=True,user_id='a57f0b89490f41d6aafd362beae0e316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Creating volume cbd7ccda-226a-4a9a-905c-ff3de20d1be7 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:42 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:42 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 1073741824 Sep 01 02:08:42 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:43 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 1073741824" returned: 0 in 0.728s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:43 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 Sep 01 02:08:43 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:43 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7" returned: 0 in 0.468s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330cb9bf-0b70-4ace-a9c0-6babd362ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a430122-212f-41e4-9a47-89cc784d8339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:44 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Volume volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 (cbd7ccda-226a-4a9a-905c-ff3de20d1be7): created successfully Sep 01 02:08:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a430122-212f-41e4-9a47-89cc784d8339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Flow 'volume_create_manager' (7703eea6-0c65-46bf-92f0-28c8017600e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f449f57f-b88f-4d79-a623-f7db19c62358 tempest-AttachVolumeNegativeTest-747698300 None] Created volume successfully. Sep 01 02:08:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b9bbd621-a4f5-4058-9584-0e9b147bde1e req-60402ec1-2500-4f7d-96dc-0e071ce4dc84 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b9bbd621-a4f5-4058-9584-0e9b147bde1e req-60402ec1-2500-4f7d-96dc-0e071ce4dc84 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b9bbd621-a4f5-4058-9584-0e9b147bde1e req-60402ec1-2500-4f7d-96dc-0e071ce4dc84 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-b9bbd621-a4f5-4058-9584-0e9b147bde1e req-60402ec1-2500-4f7d-96dc-0e071ce4dc84 tempest-AttachVolumeNegativeTest-747698300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8526c482-5df9-42ba-a2cd-0fd29286ae12', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-b9bbd621-a4f5-4058-9584-0e9b147bde1e req-60402ec1-2500-4f7d-96dc-0e071ce4dc84 tempest-AttachVolumeNegativeTest-747698300 None] attachment_update completed successfully. Sep 01 02:08:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-32405890-7efc-4edf-98b9-b370162f1d97 req-342bf4f2-3f43-479f-a861-bd785559a654 tempest-AttachVolumeNegativeTest-747698300 None] Terminate volume connection completed successfully. Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-32405890-7efc-4edf-98b9-b370162f1d97 req-342bf4f2-3f43-479f-a861-bd785559a654 tempest-AttachVolumeNegativeTest-747698300 None] Deleting attachment 8526c482-5df9-42ba-a2cd-0fd29286ae12. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Flow 'volume_create_manager' (62ab07c4-d905-426d-9c5b-f5f696ef33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e58b0a-18b7-47bf-9ac7-5e89405f3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e58b0a-18b7-47bf-9ac7-5e89405f3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1356691516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e665e0b-8afa-4149-a677-576d1ba998e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542b21f6cb44d4f987e697558db7949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:50Z,use_quota=True,user_id='9cbb4df6fb0e4a91946e58456c6af436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a93abc-91ae-4aba-bc5e-20a4cdeee52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a93abc-91ae-4aba-bc5e-20a4cdeee52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d9c9f-45b0-4f44-ae23-0c426daa29a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d9c9f-45b0-4f44-ae23-0c426daa29a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e665e0b-8afa-4149-a677-576d1ba998e4', 'volume_name': 'volume-4e665e0b-8afa-4149-a677-576d1ba998e4', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b54fb81-88c3-44f9-967a-f46ed1bee05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b54fb81-88c3-44f9-967a-f46ed1bee05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2546f42d-4a7c-434c-be7e-880d9cdc8d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Volume 4e665e0b-8afa-4149-a677-576d1ba998e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e665e0b-8afa-4149-a677-576d1ba998e4', 'volume_size': 1} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1356691516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e665e0b-8afa-4149-a677-576d1ba998e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542b21f6cb44d4f987e697558db7949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:50Z,use_quota=True,user_id='9cbb4df6fb0e4a91946e58456c6af436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Creating volume 4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:49 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:08:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 1073741824 Sep 01 02:08:49 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 1073741824" returned: 0 in 1.316s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 Sep 01 02:08:51 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4" returned: 0 in 0.513s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2546f42d-4a7c-434c-be7e-880d9cdc8d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e665e0b-8afa-4149-a677-576d1ba998e4', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165c57a9-2f0c-4e61-967c-62ff929f0408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Volume volume-4e665e0b-8afa-4149-a677-576d1ba998e4 (4e665e0b-8afa-4149-a677-576d1ba998e4): created successfully Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165c57a9-2f0c-4e61-967c-62ff929f0408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Flow 'volume_create_manager' (62ab07c4-d905-426d-9c5b-f5f696ef33bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-44034634-0d87-41ec-95bd-293f9e33fb7b tempest-VolumesDeleteCascade-144424180 None] Created volume successfully. Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Creating offline snapshot c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 of volume 4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[42340bd4-1c4c-4f7a-a5f7-6feffd62723b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 Sep 01 02:08:53 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:53 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4" returned: 0 in 0.671s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 1G Sep 01 02:08:53 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 1G" returned: 0 in 1.059s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e665e0b-8afa-4149-a677-576d1ba998e4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:54 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e665e0b-8afa-4149-a677-576d1ba998e4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:08:54 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:55 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e665e0b-8afa-4149-a677-576d1ba998e4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.585s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:55 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 is being set with open permissions: ugo+rw Sep 01 02:08:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:55 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:08:55 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:55 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.407s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:55 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=108,cinder:DELETE=8,cinder:SELECT=96,cinder:INSERT=32 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:56 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info Sep 01 02:08:56 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:56 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info" returned: 0 in 0.355s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:56 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info is being set with open permissions: ugo+rw Sep 01 02:08:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:56 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info Sep 01 02:08:56 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:56 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.info" returned: 0 in 0.318s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.544s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c9e8eb93-7088-4ce1-b1c0-32dc52f76acd tempest-VolumesDeleteCascade-144424180 None] Create snapshot completed successfully Sep 01 02:08:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Creating offline snapshot 614cf581-4452-44cf-8fec-eb8dc0d1be44 of volume 4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:08:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e567abf3-cab2-4fcc-b026-3edecfda5e59]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:57 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:08:57 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "cinder-cbd7ccda-226a-4a9a-905c-ff3de20d1be7-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:58 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.618s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e665e0b-8afa-4149-a677-576d1ba998e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-cbd7ccda-226a-4a9a-905c-ff3de20d1be7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:58 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 1G Sep 01 02:08:58 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "cinder-quobyte-cbd7ccda-226a-4a9a-905c-ff3de20d1be7" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-quobyte-cbd7ccda-226a-4a9a-905c-ff3de20d1be7" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220760b-21a4-4a6b-b562-157b75f52537]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 Sep 01 02:08:58 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 1G" returned: 0 in 0.633s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7" returned: 0 in 0.512s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:59 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 Sep 01 02:08:59 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7 Sep 01 02:08:59 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cbd7ccda-226a-4a9a-905c-ff3de20d1be7" returned: 0 in 0.328s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-quobyte-cbd7ccda-226a-4a9a-905c-ff3de20d1be7" released by "delete_volume" :: held 0.892s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:59 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44" returned: 0 in 0.400s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:59 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 is being set with open permissions: ugo+rw Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:59 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 Sep 01 02:08:59 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Created reservations ['4398f80a-5eca-4d87-8e66-6b3d40747a21', '9d5d54cc-6818-4ac4-9140-3654dba5b50f', '82d5fbd6-e36e-4405-823e-998b07ac096d', '0222184d-59c2-49c0-bc56-e62b3af0ca33'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:59 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:08:59 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44" returned: 0 in 0.321s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:59 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-eeeb4517-669f-4841-bffe-64752e811ad2 tempest-VolumesDeleteCascade-144424180 None] Create snapshot completed successfully Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.278s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Deleted volume successfully. Sep 01 02:08:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2e44cffd-0bcb-4282-ae33-9e1b721d0fe7 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-cbd7ccda-226a-4a9a-905c-ff3de20d1be7-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "cinder-0adc6750-fabe-43e7-b073-5eb65627203c-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-0adc6750-fabe-43e7-b073-5eb65627203c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "cinder-quobyte-0adc6750-fabe-43e7-b073-5eb65627203c" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-quobyte-0adc6750-fabe-43e7-b073-5eb65627203c" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da4530-0020-4dfd-bf77-1e541893ddf8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-4e665e0b-8afa-4149-a677-576d1ba998e4-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:00 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c Sep 01 02:09:00 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-4e665e0b-8afa-4149-a677-576d1ba998e4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Performing cascade delete. {{(pid=87404) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-614cf581-4452-44cf-8fec-eb8dc0d1be44-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-614cf581-4452-44cf-8fec-eb8dc0d1be44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-614cf581-4452-44cf-8fec-eb8dc0d1be44" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-614cf581-4452-44cf-8fec-eb8dc0d1be44" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Deleting offline snapshot 614cf581-4452-44cf-8fec-eb8dc0d1be44 of volume 4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] snapshot_file for this snap is: volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ac1945-a94f-48b5-970f-a8dd28ec3931]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c" returned: 0 in 0.434s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 Sep 01 02:09:01 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c Sep 01 02:09:01 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0adc6750-fabe-43e7-b073-5eb65627203c" returned: 0 in 0.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:01 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-quobyte-0adc6750-fabe-43e7-b073-5eb65627203c" released by "delete_volume" :: held 0.818s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44" returned: 0 in 0.468s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e665e0b-8afa-4149-a677-576d1ba998e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da276d1-ad8d-41ae-a276-e753d83b4c85]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Created reservations ['cfa1efa2-ff33-4da3-b69a-73d112c16016', 'f8a1efa2-2f9c-4ce6-97ef-eeb5e5fae7ac', '5058de21-8cee-428e-8a58-efde1e5cf935', '215810bc-a960-44b0-9a62-8e34a13238c1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:01 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:09:01 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:02 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:02 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.426s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e665e0b-8afa-4149-a677-576d1ba998e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:02 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 Sep 01 02:09:02 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Deleted volume successfully. Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2cd548c6-a0d0-48f9-94e3-6bf8878d5866 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-0adc6750-fabe-43e7-b073-5eb65627203c-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:02 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44" returned: 0 in 0.470s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:02 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44 Sep 01 02:09:02 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.614cf581-4452-44cf-8fec-eb8dc0d1be44" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-614cf581-4452-44cf-8fec-eb8dc0d1be44" released by "_delete_snapshot" :: held 1.770s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" released by "delete_snapshot" :: held 1.806s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:02 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Created reservations ['6232eb76-0c97-412e-b244-34a3a2db4b50', 'c33d5148-ce83-4403-a028-f1f47991d599', '9d83270c-985e-456d-a457-4e28bb08aa5a', '6673e0a5-0a91-409a-84b5-4251903a3924'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Delete snapshot completed successfully. Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-614cf581-4452-44cf-8fec-eb8dc0d1be44-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-c4fad9b5-39e5-413e-85cb-a7a6a4a047a7-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-c4fad9b5-39e5-413e-85cb-a7a6a4a047a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Deleting offline snapshot c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 of volume 4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] snapshot_file for this snap is: volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb498c08-fbdd-4e49-8555-e0e5c5e86fec]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "cinder-11d771a8-cd04-4355-9749-71182b2f7db7-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-11d771a8-cd04-4355-9749-71182b2f7db7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:03 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:09:03 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "cinder-quobyte-11d771a8-cd04-4355-9749-71182b2f7db7" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-quobyte-11d771a8-cd04-4355-9749-71182b2f7db7" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32bf3c-4fec-4410-b93c-819d34555332]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 Sep 01 02:09:03 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.478s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e665e0b-8afa-4149-a677-576d1ba998e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e5a0f7-048f-4736-99ad-519725fa99eb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 Sep 01 02:09:03 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7" returned: 0 in 0.456s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7 Sep 01 02:09:03 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:04 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4" returned: 0 in 0.444s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:04 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:09:04 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:04 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-11d771a8-cd04-4355-9749-71182b2f7db7" returned: 0 in 0.467s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-quobyte-11d771a8-cd04-4355-9749-71182b2f7db7" released by "delete_volume" :: held 0.975s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Created reservations ['49a1f5cb-597f-4f02-8ef4-d6c554b8b068', 'd783df4f-a41d-41ad-82b5-d81757143203', 'dadcd2cd-2f41-4f57-817b-455e93bc041f', '120915b1-2145-4ba7-ba66-716e2c90a6dd'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:04 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:04 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:04 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.479s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:04 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7 Sep 01 02:09:04 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:04 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Deleted volume successfully. Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2404ca06-f89b-4705-86d6-142b041855b5 tempest-AttachVolumeNegativeTest-747698300 None] Lock "cinder-11d771a8-cd04-4355-9749-71182b2f7db7-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:04 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4.c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-c4fad9b5-39e5-413e-85cb-a7a6a4a047a7" released by "_delete_snapshot" :: held 1.822s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" released by "delete_snapshot" :: held 1.859s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Created reservations ['c67c7d63-3c34-4bb7-97d7-cf8c484776c1', 'c6e023bb-79e3-4dec-ad6d-f2f957644c87', '3b5efbe6-39de-4f0d-840c-59e926075912', '92190619-8157-4379-bc9e-7f01ae808a97'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Delete snapshot completed successfully. Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-c4fad9b5-39e5-413e-85cb-a7a6a4a047a7-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Snapshots deleted, issuing volume delete {{(pid=87404) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449eaed-ddb3-44b9-88f3-03792c885f67]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:05 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 Sep 01 02:09:05 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:05 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4" returned: 0 in 0.400s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:05 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4 Sep 01 02:09:05 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:05 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e665e0b-8afa-4149-a677-576d1ba998e4" returned: 0 in 0.395s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4e665e0b-8afa-4149-a677-576d1ba998e4" released by "delete_volume" :: held 0.866s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Created reservations ['247249b9-890b-480f-92c5-7e0198a42f8d', 'c88d1647-6cb6-451d-8360-8050feef8db5', '71772fe1-47b7-47f7-b23b-29b0dc15d2af', '09c4e2c1-7292-473b-8a16-894b829ba475'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:06 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:06 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:06 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.333s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Deleted volume successfully. Sep 01 02:09:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-147745ba-fd02-4f26-a6ed-acab055016f3 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-4e665e0b-8afa-4149-a677-576d1ba998e4-delete_volume" released by "delete_volume" :: held 5.590s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Flow 'volume_create_manager' (b7e5c3c4-2e73-46ac-832f-b6deb6e45ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39fc953-850f-4208-b97d-0b02bb4bbeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39fc953-850f-4208-b97d-0b02bb4bbeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2079363881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665cbbfd-a81a-4049-bec3-ee59f68a2c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542b21f6cb44d4f987e697558db7949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:07Z,use_quota=True,user_id='9cbb4df6fb0e4a91946e58456c6af436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40829222-2842-4e79-8537-a8a0725fe6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40829222-2842-4e79-8537-a8a0725fe6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b4c1c7-a73b-4de4-83b8-21fab2b0219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b4c1c7-a73b-4de4-83b8-21fab2b0219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665cbbfd-a81a-4049-bec3-ee59f68a2c13', 'volume_name': 'volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ba07a-f069-49cb-a075-1b7fa9d5429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ba07a-f069-49cb-a075-1b7fa9d5429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff532d91-32a1-46ca-8124-6017c6656daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:07 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Volume 665cbbfd-a81a-4049-bec3-ee59f68a2c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13', 'volume_size': 1} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2079363881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665cbbfd-a81a-4049-bec3-ee59f68a2c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542b21f6cb44d4f987e697558db7949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:07Z,use_quota=True,user_id='9cbb4df6fb0e4a91946e58456c6af436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Creating volume 665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:07 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:09:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:07 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 1073741824 Sep 01 02:09:07 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:08 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 1073741824" returned: 0 in 0.650s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:08 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 Sep 01 02:09:08 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:08 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff532d91-32a1-46ca-8124-6017c6656daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be1c05-8d43-4679-8d3b-d66068ee2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:08 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Volume volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 (665cbbfd-a81a-4049-bec3-ee59f68a2c13): created successfully Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be1c05-8d43-4679-8d3b-d66068ee2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Flow 'volume_create_manager' (b7e5c3c4-2e73-46ac-832f-b6deb6e45ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-51721f88-f451-444a-8d8f-b3bb0b896259 tempest-VolumesDeleteCascade-144424180 None] Created volume successfully. Sep 01 02:09:09 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=100,cinder:UPDATE=120,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Creating offline snapshot 369a40b6-2db3-4754-9bf0-d25afb99dfd8 of volume 665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6418a6-5483-402d-bb67-0531e1ab8025]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:09 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 Sep 01 02:09:09 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:10 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13" returned: 0 in 0.563s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:10 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 1G Sep 01 02:09:10 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:10 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 1G" returned: 0 in 0.678s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:11 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 Sep 01 02:09:11 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:11 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8" returned: 0 in 0.409s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:11 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 is being set with open permissions: ugo+rw Sep 01 02:09:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:11 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 Sep 01 02:09:11 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:11 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8" returned: 0 in 0.337s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:11 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info Sep 01 02:09:11 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:12 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info" returned: 0 in 0.435s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:12 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info is being set with open permissions: ugo+rw Sep 01 02:09:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:12 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info Sep 01 02:09:12 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:12 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.info" returned: 0 in 0.320s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a929cb12-ccd2-4467-8674-fe7163befbd6 tempest-VolumesDeleteCascade-144424180 None] Create snapshot completed successfully Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Flow 'volume_create_manager' (99793bb4-2183-4828-aa6f-05f54d76efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2734c8c4-3adf-44ab-ae25-376a99b296af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2734c8c4-3adf-44ab-ae25-376a99b296af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1582634589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542b21f6cb44d4f987e697558db7949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=369a40b6-2db3-4754-9bf0-d25afb99dfd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:13Z,use_quota=True,user_id='9cbb4df6fb0e4a91946e58456c6af436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0057664-72fd-4183-8b1b-0a3e5b997a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0057664-72fd-4183-8b1b-0a3e5b997a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550995b1-fdd2-4003-a05e-8dca7216fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550995b1-fdd2-4003-a05e-8dca7216fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba', 'volume_name': 'volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba', 'volume_size': 1, 'snapshot_id': '369a40b6-2db3-4754-9bf0-d25afb99dfd8'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0195679d-2d60-4da5-a1a9-63be5091c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0195679d-2d60-4da5-a1a9-63be5091c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b840626-f563-4777-94c3-27731dd2b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:13 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Volume 4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba', 'volume_size': 1, 'snapshot_id': '369a40b6-2db3-4754-9bf0-d25afb99dfd8'} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-369a40b6-2db3-4754-9bf0-d25afb99dfd8-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-369a40b6-2db3-4754-9bf0-d25afb99dfd8-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Creating volume 4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba from snapshot 369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] snapshot: 369a40b6-2db3-4754-9bf0-d25afb99dfd8, volume: 4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e63db8-7670-4a52-ac45-d87c894fd400]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:13 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 Sep 01 02:09:13 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8" returned: 0 in 0.392s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e15f14-61db-4a10-a200-61c301f675c8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:14 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 Sep 01 02:09:14 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13" returned: 0 in 0.391s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:09:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:14 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba Sep 01 02:09:14 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-e78aeef0-6862-4355-8618-868599bd4d40 req-edba07bb-ec60-4953-a96c-49d9c9f1983b tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" returned: 0 in 6.805s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:21 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Converted 1024.00 MB image at 150.46 MB/s Sep 01 02:09:21 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba is being set with open permissions: ugo+rw Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba Sep 01 02:09:21 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" returned: 0 in 0.329s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" released by "_copy_volume_from_snapshot" :: held 8.021s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-369a40b6-2db3-4754-9bf0-d25afb99dfd8-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" released by "_create_volume_from_snapshot" :: held 8.114s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.134s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-e78aeef0-6862-4355-8618-868599bd4d40 req-edba07bb-ec60-4953-a96c-49d9c9f1983b tempest-TestStampPattern-722925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.665s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-e78aeef0-6862-4355-8618-868599bd4d40 req-edba07bb-ec60-4953-a96c-49d9c9f1983b tempest-TestStampPattern-722925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b840626-f563-4777-94c3-27731dd2b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba', 'volume_size': 1, 'snapshot_id': '369a40b6-2db3-4754-9bf0-d25afb99dfd8'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d68f344-895b-4a42-852a-47887868e051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Volume volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba (4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba): created successfully Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d68f344-895b-4a42-852a-47887868e051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Flow 'volume_create_manager' (99793bb4-2183-4828-aa6f-05f54d76efc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-e78aeef0-6862-4355-8618-868599bd4d40 req-edba07bb-ec60-4953-a96c-49d9c9f1983b tempest-TestStampPattern-722925626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-008cc174-ff3a-4cda-a4df-f8c28d79e845', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '396533d9-81d7-4918-a6de-90ae37efabc5', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:09:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b8d3a9da-803d-4e64-bdaf-951509619852 tempest-VolumesDeleteCascade-144424180 None] Created volume successfully. Sep 01 02:09:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-e78aeef0-6862-4355-8618-868599bd4d40 req-edba07bb-ec60-4953-a96c-49d9c9f1983b tempest-TestStampPattern-722925626 None] attachment_update completed successfully. Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-665cbbfd-a81a-4049-bec3-ee59f68a2c13-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-665cbbfd-a81a-4049-bec3-ee59f68a2c13-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Performing cascade delete. {{(pid=87404) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-369a40b6-2db3-4754-9bf0-d25afb99dfd8-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-369a40b6-2db3-4754-9bf0-d25afb99dfd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-665cbbfd-a81a-4049-bec3-ee59f68a2c13" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-665cbbfd-a81a-4049-bec3-ee59f68a2c13" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-369a40b6-2db3-4754-9bf0-d25afb99dfd8" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-369a40b6-2db3-4754-9bf0-d25afb99dfd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Deleting offline snapshot 369a40b6-2db3-4754-9bf0-d25afb99dfd8 of volume 665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] snapshot_file for this snap is: volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce71f81-1ea0-46ab-98e7-3555611dc3cc]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 Sep 01 02:09:23 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8" returned: 0 in 0.491s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcd5d67-0b39-4dcf-a721-20762aa25641]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 Sep 01 02:09:24 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Flow 'volume_create_manager' (c355c76d-6e9f-4d10-be7a-4f6ea3c95d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033a3381-ab7c-40f7-aa40-321e514b44c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033a3381-ab7c-40f7-aa40-321e514b44c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1603448818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0feeba-0558-4950-82ec-2a56f3e6062b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d4807cd15f4c8cbc10a90050fd631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:25Z,use_quota=True,user_id='2cc87e13cb2f4cc8a2edc37a8b824ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c70d3fa-4cea-4761-ace6-8b298bfc4242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c70d3fa-4cea-4761-ace6-8b298bfc4242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5652f126-f495-42c0-ae98-93b32caf81ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5652f126-f495-42c0-ae98-93b32caf81ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0feeba-0558-4950-82ec-2a56f3e6062b', 'volume_name': 'volume-9d0feeba-0558-4950-82ec-2a56f3e6062b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7d688c-e540-4cca-a82c-abde6d026546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7d688c-e540-4cca-a82c-abde6d026546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec7b45c-1815-4f24-b5f4-40a48412ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Volume 9d0feeba-0558-4950-82ec-2a56f3e6062b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0feeba-0558-4950-82ec-2a56f3e6062b', 'volume_size': 1} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1603448818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0feeba-0558-4950-82ec-2a56f3e6062b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d4807cd15f4c8cbc10a90050fd631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:25Z,use_quota=True,user_id='2cc87e13cb2f4cc8a2edc37a8b824ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Creating volume 9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:25 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b 1073741824 Sep 01 02:09:25 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13" returned: 0 in 1.642s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 Sep 01 02:09:25 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8" returned: 0 in 0.531s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b 1073741824" returned: 0 in 0.931s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8 Sep 01 02:09:26 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b Sep 01 02:09:26 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13.369a40b6-2db3-4754-9bf0-d25afb99dfd8" returned: 0 in 0.404s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-369a40b6-2db3-4754-9bf0-d25afb99dfd8" released by "_delete_snapshot" :: held 3.249s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-665cbbfd-a81a-4049-bec3-ee59f68a2c13" released by "delete_snapshot" :: held 3.289s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-aa1ac119-2525-4154-a86b-2ed49fa4e6bd req-6faad126-daba-47da-b545-3122ab39380c tempest-TestStampPattern-722925626 None] Terminate volume connection completed successfully. Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-aa1ac119-2525-4154-a86b-2ed49fa4e6bd req-6faad126-daba-47da-b545-3122ab39380c tempest-TestStampPattern-722925626 None] Deleting attachment 396533d9-81d7-4918-a6de-90ae37efabc5. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Created reservations ['08afb847-b991-4e9e-8751-3b4433ae5919', '09cfcea1-16b9-49a9-a1f8-d91aad1b19e4', '5feb9985-41bc-4f9e-94e9-1c13ca152437', 'ac5fb9aa-3826-411f-a847-f0f517654b26'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:26 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b" returned: 0 in 0.509s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec7b45c-1815-4f24-b5f4-40a48412ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0feeba-0558-4950-82ec-2a56f3e6062b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4c44f9-6f90-4ac1-acb0-1b78f6b5bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Volume volume-9d0feeba-0558-4950-82ec-2a56f3e6062b (9d0feeba-0558-4950-82ec-2a56f3e6062b): created successfully Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4c44f9-6f90-4ac1-acb0-1b78f6b5bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Flow 'volume_create_manager' (c355c76d-6e9f-4d10-be7a-4f6ea3c95d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-2db08231-cd75-4918-b385-05eefb1886ea req-8bb867c1-0d52-464b-b7e6-589fd363590b tempest-VolumesSnapshotsTestJSON-751317226 None] Created volume successfully. Sep 01 02:09:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Delete snapshot completed successfully. Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-369a40b6-2db3-4754-9bf0-d25afb99dfd8-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Snapshots deleted, issuing volume delete {{(pid=87404) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-665cbbfd-a81a-4049-bec3-ee59f68a2c13" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-665cbbfd-a81a-4049-bec3-ee59f68a2c13" acquired by "delete_volume" :: waited 0.033s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99a8b8c-1416-4ad3-aa37-f6ff8451e7f7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 Sep 01 02:09:27 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Creating offline snapshot 225c608c-9da4-4d10-aa5e-998b5b71fe39 of volume 9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77cf007-b748-4660-872a-32c3c5440094]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13" returned: 0 in 0.789s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13 Sep 01 02:09:27 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b Sep 01 02:09:27 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-665cbbfd-a81a-4049-bec3-ee59f68a2c13" returned: 0 in 0.543s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-665cbbfd-a81a-4049-bec3-ee59f68a2c13" released by "delete_volume" :: held 1.472s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Created reservations ['d7202cd0-3a96-427e-be85-bef30a47b866', '27396da7-151b-45b7-a514-ac3669627e0d', 'e32e4872-a762-455b-9190-ed4cd8ee0a9b', 'c0131f85-bc54-4013-b7ae-b87d08db13f9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:28 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b" returned: 0 in 0.784s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 1G Sep 01 02:09:28 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:28 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:28 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.719s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:09:29 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.869s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Deleted volume successfully. Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5f39a3f-0e83-4279-920f-6b51ff39a1de tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-665cbbfd-a81a-4049-bec3-ee59f68a2c13-delete_volume" released by "delete_volume" :: held 6.488s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "cinder-quobyte-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:29 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 1G" returned: 0 in 1.295s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0feeba-0558-4950-82ec-2a56f3e6062b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:29 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0feeba-0558-4950-82ec-2a56f3e6062b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 Sep 01 02:09:29 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd216d-02ac-4548-905d-30d40666dde8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba Sep 01 02:09:29 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" returned: 0 in 0.719s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba Sep 01 02:09:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0feeba-0558-4950-82ec-2a56f3e6062b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39" returned: 0 in 0.842s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 is being set with open permissions: ugo+rw Sep 01 02:09:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 Sep 01 02:09:30 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" returned: 0 in 0.438s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-quobyte-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba" released by "delete_volume" :: held 1.226s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Created reservations ['a720533e-f5ad-45db-b7ae-7abbb13c39fb', '08c23912-a9c9-479c-80f9-fe4243f2ab85', 'b1e09dce-324f-48b5-a4fd-6686d5fa9119', 'd54b7739-fc86-4ba2-8a3e-9f019fa420f0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:31 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39" returned: 0 in 0.535s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info Sep 01 02:09:31 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:31 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info" returned: 0 in 0.618s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info is being set with open permissions: ugo+rw Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.559s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Deleted volume successfully. Sep 01 02:09:31 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info Sep 01 02:09:31 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cc081c75-5179-4a11-971a-2b99b4913d7a tempest-VolumesDeleteCascade-144424180 None] Lock "cinder-4bcf8ead-fd24-4599-9ccb-2b67a0c7d7ba-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:32 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.info" returned: 0 in 0.593s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-73573623-5be8-4423-868f-5c2f3810f293 req-f6329716-c6f9-4ca0-8a3f-3bd3c7681eb0 tempest-VolumesSnapshotsTestJSON-751317226 None] Create snapshot completed successfully Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "cinder-225c608c-9da4-4d10-aa5e-998b5b71fe39-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-225c608c-9da4-4d10-aa5e-998b5b71fe39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "cinder-quobyte-9d0feeba-0558-4950-82ec-2a56f3e6062b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-quobyte-9d0feeba-0558-4950-82ec-2a56f3e6062b" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "cinder-quobyte-225c608c-9da4-4d10-aa5e-998b5b71fe39" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-quobyte-225c608c-9da4-4d10-aa5e-998b5b71fe39" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Deleting offline snapshot 225c608c-9da4-4d10-aa5e-998b5b71fe39 of volume 9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] snapshot_file for this snap is: volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8f1041-20de-49ee-892a-d2adc5053319]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 Sep 01 02:09:33 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-008cc174-ff3a-4cda-a4df-f8c28d79e845-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Lock "cinder-008cc174-ff3a-4cda-a4df-f8c28d79e845-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-quobyte-008cc174-ff3a-4cda-a4df-f8c28d79e845" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-008cc174-ff3a-4cda-a4df-f8c28d79e845" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc171986-aeb1-4a5f-9b42-b66d97226875]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39" returned: 0 in 0.593s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0feeba-0558-4950-82ec-2a56f3e6062b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcd5232-e256-479a-b7dc-1464be30596d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 Sep 01 02:09:33 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b Sep 01 02:09:33 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845" returned: 0 in 0.476s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845 Sep 01 02:09:34 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b" returned: 0 in 0.518s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 Sep 01 02:09:34 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-008cc174-ff3a-4cda-a4df-f8c28d79e845" returned: 0 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-008cc174-ff3a-4cda-a4df-f8c28d79e845" released by "delete_volume" :: held 0.905s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Created reservations ['ef5603da-e9e4-47e0-be4f-55c1ebe05d60', '572f1e6e-49c4-4b87-b4fc-b2f1a86e62e2', '022b4513-ed32-4a61-87e1-c8f0817b83f1', 'ebcf537a-f0b0-48ba-b58e-65a2ea0a0684'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:34 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39" returned: 0 in 0.601s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39 Sep 01 02:09:34 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.359s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Deleted volume successfully. Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-72802d72-4315-484e-a88e-d083425c60d8 tempest-TestStampPattern-722925626 None] Lock "cinder-008cc174-ff3a-4cda-a4df-f8c28d79e845-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:35 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b.225c608c-9da4-4d10-aa5e-998b5b71fe39" returned: 0 in 0.312s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-quobyte-225c608c-9da4-4d10-aa5e-998b5b71fe39" released by "_delete_snapshot" :: held 2.199s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-quobyte-9d0feeba-0558-4950-82ec-2a56f3e6062b" released by "delete_snapshot" :: held 2.260s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.quota [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Created reservations ['f43c7a7e-20f6-41cc-b1cb-06942cc12e55', '22b73934-f53d-4641-8005-d41105920d16', '556a7e1b-2730-4277-848a-3bd6b602a5bb', '578e91ec-d203-4159-a466-76cf4b733ef8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Delete snapshot completed successfully. Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-77b81804-09be-46a8-ae40-03e0a296f500 req-3741ca7e-551f-4c31-8a0a-b594be3f043c tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-225c608c-9da4-4d10-aa5e-998b5b71fe39-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-f658f220-1dd7-4140-8340-c3d1f59e4b6f-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Lock "cinder-f658f220-1dd7-4140-8340-c3d1f59e4b6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-quobyte-491b366d-13a1-4660-a960-2aa74bd64b66" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-491b366d-13a1-4660-a960-2aa74bd64b66" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-quobyte-f658f220-1dd7-4140-8340-c3d1f59e4b6f" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-f658f220-1dd7-4140-8340-c3d1f59e4b6f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Deleting offline snapshot f658f220-1dd7-4140-8340-c3d1f59e4b6f of volume 491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] snapshot_file for this snap is: volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e95b6-ac79-4112-a3e8-5c20bfcace40]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f Sep 01 02:09:36 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "cinder-9d0feeba-0558-4950-82ec-2a56f3e6062b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-9d0feeba-0558-4950-82ec-2a56f3e6062b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "cinder-quobyte-9d0feeba-0558-4950-82ec-2a56f3e6062b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-quobyte-9d0feeba-0558-4950-82ec-2a56f3e6062b" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c8f699-7c15-48f6-b532-e5e0321e9f45]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f" returned: 0 in 0.509s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-491b366d-13a1-4660-a960-2aa74bd64b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6f332c-6658-4433-b913-6d1e88908ebb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b Sep 01 02:09:36 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 Sep 01 02:09:36 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b" returned: 0 in 0.482s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:37 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b Sep 01 02:09:37 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9d0feeba-0558-4950-82ec-2a56f3e6062b" returned: 0 in 0.450s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66" returned: 0 in 0.907s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-quobyte-9d0feeba-0558-4950-82ec-2a56f3e6062b" released by "delete_volume" :: held 1.034s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:37 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f Sep 01 02:09:37 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG cinder.quota [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Created reservations ['e1f6fb77-cf3b-44b7-8dda-8494f4ea0aad', 'cb2b28e5-e318-4043-bba7-6d81463f5f99', '244f039e-e309-4636-89f0-4416ebcc5d15', '87234137-5533-4ebe-a862-75213f73eb6c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:37 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:37 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f" returned: 0 in 0.475s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:38 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f Sep 01 02:09:38 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:38 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.352s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG cinder.manager [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Deleted volume successfully. Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [req-b82b7161-d48f-4d61-9ebf-9ae13cb22581 req-ac9cfb67-dc6d-4249-b5ce-5db17d91384d tempest-VolumesSnapshotsTestJSON-751317226 None] Lock "cinder-9d0feeba-0558-4950-82ec-2a56f3e6062b-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:38 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66.f658f220-1dd7-4140-8340-c3d1f59e4b6f" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-f658f220-1dd7-4140-8340-c3d1f59e4b6f" released by "_delete_snapshot" :: held 2.320s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-491b366d-13a1-4660-a960-2aa74bd64b66" released by "delete_snapshot" :: held 2.352s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Created reservations ['e3db3d3d-438a-4b94-990b-ee4034445cb6', 'd21d46f2-00b7-49d9-92b7-d041d595e819', '07392352-8449-47f0-8aab-7840757211ad', '2f2bf6d4-6208-468c-b503-f315379180d0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Delete snapshot completed successfully. Sep 01 02:09:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a32631f3-7f77-4040-bf75-692798d8abf2 tempest-TestStampPattern-722925626 None] Lock "cinder-f658f220-1dd7-4140-8340-c3d1f59e4b6f-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-491b366d-13a1-4660-a960-2aa74bd64b66-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Lock "cinder-491b366d-13a1-4660-a960-2aa74bd64b66-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Acquiring lock "cinder-quobyte-491b366d-13a1-4660-a960-2aa74bd64b66" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-491b366d-13a1-4660-a960-2aa74bd64b66" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d325c8e9-921f-492c-b24a-5772e90298df]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 Sep 01 02:09:45 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66" returned: 0 in 0.562s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66 Sep 01 02:09:45 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-491b366d-13a1-4660-a960-2aa74bd64b66" returned: 0 in 0.417s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Lock "cinder-quobyte-491b366d-13a1-4660-a960-2aa74bd64b66" released by "delete_volume" :: held 1.102s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Created reservations ['e93f2bb7-aadf-4122-840d-05dbd78e756b', 'ea13f912-8ec1-4850-9210-c8cac032ebbd', '9c54b66a-ac56-4b95-83ee-2c8e4154fef6', 'ca1e1a00-3077-43b6-95a1-9fbcae557ef6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:09:46 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Deleted volume successfully. Sep 01 02:09:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-927046ce-0fd0-4bff-9cad-a8bb6eeec738 tempest-TestStampPattern-722925626 None] Lock "cinder-491b366d-13a1-4660-a960-2aa74bd64b66-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Flow 'volume_create_manager' (5bea6471-b1c8-4ec3-bc87-64ab6bfc6e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d11dfe8-ca21-46f2-87dd-fb6c661cd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d11dfe8-ca21-46f2-87dd-fb6c661cd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-777238092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfff34fc6e64c7298b4e7a0370187ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:48Z,use_quota=True,user_id='83eb1e09c8ed4c0fa2db42f30db34f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c23b74-7753-40e6-8abe-c2c9462fae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c23b74-7753-40e6-8abe-c2c9462fae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8fda70-d433-4f3f-b729-501950b14256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8fda70-d433-4f3f-b729-501950b14256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb', 'volume_name': 'volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ef014d-1779-4dc9-ae63-cd655a88237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ef014d-1779-4dc9-ae63-cd655a88237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381c427d-d050-4db7-b994-f4226275a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Volume 6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb', 'volume_size': 1} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-777238092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfff34fc6e64c7298b4e7a0370187ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:48Z,use_quota=True,user_id='83eb1e09c8ed4c0fa2db42f30db34f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Creating volume 6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:48 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:09:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb 1073741824 Sep 01 02:09:48 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb 1073741824" returned: 0 in 0.581s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:09:49 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.447s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381c427d-d050-4db7-b994-f4226275a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ad1ab7-6018-4747-afd2-90463a31e77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Volume volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb (6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb): created successfully Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ad1ab7-6018-4747-afd2-90463a31e77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Flow 'volume_create_manager' (5bea6471-b1c8-4ec3-bc87-64ab6bfc6e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8c4ac49c-913f-48c0-bb4c-5743b26ed25b tempest-VolumesActionsTest-1076223932 None] Created volume successfully. Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Flow 'volume_create_manager' (43d4b088-f0b2-47ff-8f5c-1292810d9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b780b9ee-ef78-4c20-b696-3e805897c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b780b9ee-ef78-4c20-b696-3e805897c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-336110036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fd0d29-3f78-4a6b-9631-d7a732be70a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c372949158d34ac89a0d698775bdac8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:52Z,use_quota=True,user_id='f001e85af5004cfb819ecabcc13f8e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fea3f14-0fa7-4c3c-95bd-53fe1a1e1bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fea3f14-0fa7-4c3c-95bd-53fe1a1e1bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd86b3ee-dbcf-4f71-b39f-7f26908675e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd86b3ee-dbcf-4f71-b39f-7f26908675e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93fd0d29-3f78-4a6b-9631-d7a732be70a0', 'volume_name': 'volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45bb0c2-3e10-44e9-a804-dfb4429e591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45bb0c2-3e10-44e9-a804-dfb4429e591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc07d06-6333-41a3-aa17-73a71596941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:51 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Volume 93fd0d29-3f78-4a6b-9631-d7a732be70a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0', 'volume_size': 1} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-336110036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fd0d29-3f78-4a6b-9631-d7a732be70a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c372949158d34ac89a0d698775bdac8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:52Z,use_quota=True,user_id='f001e85af5004cfb819ecabcc13f8e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Creating volume 93fd0d29-3f78-4a6b-9631-d7a732be70a0 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:51 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:09:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:51 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 1073741824 Sep 01 02:09:51 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:52 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 1073741824" returned: 0 in 0.638s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:52 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 Sep 01 02:09:52 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:52 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0" returned: 0 in 0.397s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc07d06-6333-41a3-aa17-73a71596941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bacc37-5d25-4600-b4d2-33306ebcd5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Volume volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 (93fd0d29-3f78-4a6b-9631-d7a732be70a0): created successfully Sep 01 02:09:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bacc37-5d25-4600-b4d2-33306ebcd5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Flow 'volume_create_manager' (43d4b088-f0b2-47ff-8f5c-1292810d9d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-200c65ca-6fec-4b6b-841a-a22baab106fe tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Created volume successfully. Sep 01 02:09:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-851aaf33-0658-4cb9-94c5-62ad074317c5 tempest-GroupSnapshotsTest-1351629572 None] Group tempest-GroupSnapshotsTest-Group-182887773: creating Sep 01 02:09:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-851aaf33-0658-4cb9-94c5-62ad074317c5 tempest-GroupSnapshotsTest-1351629572 None] Group tempest-GroupSnapshotsTest-Group-182887773: created successfully Sep 01 02:09:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-851aaf33-0658-4cb9-94c5-62ad074317c5 tempest-GroupSnapshotsTest-1351629572 None] Create group completed successfully. Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b5e3f76b-920d-447d-bf57-f2d0a5110d21 req-1e4be1e8-85f3-4dc4-97aa-f44fa2752258 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b5e3f76b-920d-447d-bf57-f2d0a5110d21 req-1e4be1e8-85f3-4dc4-97aa-f44fa2752258 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-b5e3f76b-920d-447d-bf57-f2d0a5110d21 req-1e4be1e8-85f3-4dc4-97aa-f44fa2752258 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-b5e3f76b-920d-447d-bf57-f2d0a5110d21 req-1e4be1e8-85f3-4dc4-97aa-f44fa2752258 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a6f6a03-41e9-46d3-a0d0-5b6d859bea4e', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (e9a5ca90-efb8-43f3-b45d-73fc47cafc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e864921-5087-4e08-a3d3-8a389706f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-b5e3f76b-920d-447d-bf57-f2d0a5110d21 req-1e4be1e8-85f3-4dc4-97aa-f44fa2752258 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] attachment_update completed successfully. Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e864921-5087-4e08-a3d3-8a389706f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637804035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68ca17dd-9cfe-4154-b6e8-cdb7c7d98b30,host='devstack@QuobyteHD#QuobyteHD',id=e13d6294-6c7d-4df3-bdd0-5dd9e81b069a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:55Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1baabe37-cd8b-49ab-9443-78ad5330e253),volume_type_id=1baabe37-cd8b-49ab-9443-78ad5330e253)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29409bb6-3c94-484d-87d6-bea14e4a0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29409bb6-3c94-484d-87d6-bea14e4a0d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5149f2ed-f544-416a-8775-72cd71d024e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5149f2ed-f544-416a-8775-72cd71d024e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13d6294-6c7d-4df3-bdd0-5dd9e81b069a', 'volume_name': 'volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbd6b9c-d54e-40b2-baea-540e2f0b0d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbd6b9c-d54e-40b2-baea-540e2f0b0d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470c1260-61fa-4b1c-b0c5-b953fe6ba27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Volume e13d6294-6c7d-4df3-bdd0-5dd9e81b069a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a', 'volume_size': 1} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68ca17dd-9cfe-4154-b6e8-cdb7c7d98b30,created_at=2026-09-01T00:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637804035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68ca17dd-9cfe-4154-b6e8-cdb7c7d98b30,host='devstack@QuobyteHD#QuobyteHD',id=e13d6294-6c7d-4df3-bdd0-5dd9e81b069a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:55Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1baabe37-cd8b-49ab-9443-78ad5330e253),volume_type_id=1baabe37-cd8b-49ab-9443-78ad5330e253)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Creating volume e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:55 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:09:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a 1073741824 Sep 01 02:09:55 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:56 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a 1073741824" returned: 0 in 0.756s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=131,cinder:SELECT=111,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:56 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a Sep 01 02:09:56 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:56 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" returned: 0 in 0.349s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470c1260-61fa-4b1c-b0c5-b953fe6ba27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a7be98-8967-4f68-b9d7-a9ee4a9ffdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:56 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Volume volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a (e13d6294-6c7d-4df3-bdd0-5dd9e81b069a): created successfully Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a7be98-8967-4f68-b9d7-a9ee4a9ffdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (e9a5ca90-efb8-43f3-b45d-73fc47cafc58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-656dfc32-150c-4cad-ab2d-256b83c922fe tempest-GroupSnapshotsTest-1351629572 None] Created volume successfully. Sep 01 02:09:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] GroupSnapshot aec2f338-0d22-4194-aa95-8b68ca014bb9: creating. Sep 01 02:09:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Group snapshot aec2f338-0d22-4194-aa95-8b68ca014bb9: creating. {{(pid=87404) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:09:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Creating offline snapshot 365ba5a8-c116-4b60-834d-e1817c3f8246 of volume e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:58 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d96fe5-65a5-4c44-8315-1922c3c7949c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a Sep 01 02:09:58 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" returned: 0 in 0.693s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 1G Sep 01 02:09:59 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-01e825b6-8f1f-450b-9921-dacbab14d82b req-f8cecd19-e6a3-4ca1-ac7e-f40316b4e936 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Terminate volume connection completed successfully. Sep 01 02:09:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-01e825b6-8f1f-450b-9921-dacbab14d82b req-f8cecd19-e6a3-4ca1-ac7e-f40316b4e936 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Deleting attachment 5a6f6a03-41e9-46d3-a0d0-5b6d859bea4e. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:10:00 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 1G" returned: 0 in 0.867s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:00 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 Sep 01 02:10:00 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Acquiring lock "cinder-93fd0d29-3f78-4a6b-9631-d7a732be70a0-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:00 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246" returned: 0 in 0.555s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:00 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "cinder-93fd0d29-3f78-4a6b-9631-d7a732be70a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:00 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 Sep 01 02:10:00 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Acquiring lock "cinder-quobyte-93fd0d29-3f78-4a6b-9631-d7a732be70a0" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "cinder-quobyte-93fd0d29-3f78-4a6b-9631-d7a732be70a0" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f896a-35cb-4186-bf97-0f8e46e89385]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 Sep 01 02:10:01 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info Sep 01 02:10:01 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0" returned: 0 in 0.476s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0 Sep 01 02:10:01 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info" returned: 0 in 0.309s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info Sep 01 02:10:01 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-93fd0d29-3f78-4a6b-9631-d7a732be70a0" returned: 0 in 0.283s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "cinder-quobyte-93fd0d29-3f78-4a6b-9631-d7a732be70a0" released by "delete_volume" :: held 0.886s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:01 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Created reservations ['202a29ee-ab2d-436c-bae2-1ab687b3973d', 'd7633792-6cba-4504-b07b-fe2ed4aeee30', '5638cd47-db79-4dbe-b9db-27fab2581642', '2567c88a-d966-4542-a947-19eb94ff9a80'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cbe27108-c40b-4964-8881-8f7556b60160 tempest-VolumesActionsTest-1076223932 None] Acquiring lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" by "attach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:02 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.info" returned: 0 in 0.453s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cbe27108-c40b-4964-8881-8f7556b60160 tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" acquired by "attach_volume" :: waited 0.068s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:02 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:02 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cbe27108-c40b-4964-8881-8f7556b60160 tempest-VolumesActionsTest-1076223932 None] Attaching volume 6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb to instance 068f82cb-8a9d-4902-ade3-c0b8aa7b67ff at mountpoint /dev/vdb on host None. Sep 01 02:10:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b4cdc5db-0dbb-4872-8438-f6621a1f9f17 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot aec2f338-0d22-4194-aa95-8b68ca014bb9: created successfully Sep 01 02:10:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cbe27108-c40b-4964-8881-8f7556b60160 tempest-VolumesActionsTest-1076223932 None] Attach volume completed successfully. Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cbe27108-c40b-4964-8881-8f7556b60160 tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" released by "attach_volume" :: held 0.485s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:02 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.564s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Deleted volume successfully. Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8ffa2355-e930-4d6d-a2d7-2955b8ea6d96 tempest-TestServerVolumeAttachScenarioOldVersion-913176411 None] Lock "cinder-93fd0d29-3f78-4a6b-9631-d7a732be70a0-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2aab89bd-25f5-4fe1-9667-8cfae6c8c519 tempest-VolumesActionsTest-1076223932 None] Acquiring lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-detach_volume" by "detach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2aab89bd-25f5-4fe1-9667-8cfae6c8c519 tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2aab89bd-25f5-4fe1-9667-8cfae6c8c519 tempest-VolumesActionsTest-1076223932 None] Detaching volume 6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb from instance 068f82cb-8a9d-4902-ade3-c0b8aa7b67ff. Sep 01 02:10:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2aab89bd-25f5-4fe1-9667-8cfae6c8c519 tempest-VolumesActionsTest-1076223932 None] Detach volume completed successfully. Sep 01 02:10:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2aab89bd-25f5-4fe1-9667-8cfae6c8c519 tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-detach_volume" released by "detach_volume" :: held 0.290s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-365ba5a8-c116-4b60-834d-e1817c3f8246-c1d64985-3b1f-48c2-a6ff-63101313e4c9" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-365ba5a8-c116-4b60-834d-e1817c3f8246-c1d64985-3b1f-48c2-a6ff-63101313e4c9" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Creating volume c1d64985-3b1f-48c2-a6ff-63101313e4c9 from snapshot 365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-c1d64985-3b1f-48c2-a6ff-63101313e4c9" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-c1d64985-3b1f-48c2-a6ff-63101313e4c9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] snapshot: 365ba5a8-c116-4b60-834d-e1817c3f8246, volume: c1d64985-3b1f-48c2-a6ff-63101313e4c9, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf5ffa-9159-413a-8394-1dafb622c247]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:04 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 Sep 01 02:10:04 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:05 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246" returned: 0 in 0.698s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b632183e-91ed-426b-99c5-378f69effb13]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:05 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a Sep 01 02:10:05 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:05 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" returned: 0 in 0.575s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:10:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:06 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 Sep 01 02:10:06 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9" returned: 0 in 6.213s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:12 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Converted 1024.00 MB image at 164.80 MB/s Sep 01 02:10:12 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:12 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 Sep 01 02:10:12 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:12 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-c1d64985-3b1f-48c2-a6ff-63101313e4c9" released by "_copy_volume_from_snapshot" :: held 7.924s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=98,cinder:UPDATE=87,cinder:DELETE=9,cinder:INSERT=24 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-365ba5a8-c116-4b60-834d-e1817c3f8246-c1d64985-3b1f-48c2-a6ff-63101313e4c9" released by "_create_volume_from_snapshot" :: held 8.021s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.039s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7893f9db-2e13-4aca-89a9-2be0ea8b6ab8 tempest-GroupSnapshotsTest-1351629572 None] Create group from source-snapshot-aec2f338-0d22-4194-aa95-8b68ca014bb9 completed successfully. Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (920da0f1-b43a-40fe-9ba6-3b1532747b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01411d53-219a-44c9-af66-62c66787e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01411d53-219a-44c9-af66-62c66787e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832239986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a0125a-4f74-4d51-8d9e-ceb547447e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:13Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdcb219-7854-4fff-8d96-4f4e9ac157a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdcb219-7854-4fff-8d96-4f4e9ac157a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9233b5c9-0789-4417-b7f9-46b0942d4bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9233b5c9-0789-4417-b7f9-46b0942d4bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a0125a-4f74-4d51-8d9e-ceb547447e93', 'volume_name': 'volume-65a0125a-4f74-4d51-8d9e-ceb547447e93', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19c12ab-a7cc-4067-a7af-269ae959504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19c12ab-a7cc-4067-a7af-269ae959504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a7c88-eb92-426f-86d0-9b57b44cd975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:13 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume 65a0125a-4f74-4d51-8d9e-ceb547447e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a0125a-4f74-4d51-8d9e-ceb547447e93', 'volume_size': 1} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832239986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a0125a-4f74-4d51-8d9e-ceb547447e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:13Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Creating volume 65a0125a-4f74-4d51-8d9e-ceb547447e93 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:13 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:13 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 1073741824 Sep 01 02:10:13 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-c1d64985-3b1f-48c2-a6ff-63101313e4c9" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-c1d64985-3b1f-48c2-a6ff-63101313e4c9" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e289fa-955b-402b-9b81-21aa161180b1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:14 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 Sep 01 02:10:14 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:14 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 1073741824" returned: 0 in 0.724s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:14 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 Sep 01 02:10:14 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:14 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9" returned: 0 in 0.669s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:14 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9 Sep 01 02:10:14 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:14 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93" returned: 0 in 0.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a7c88-eb92-426f-86d0-9b57b44cd975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a0125a-4f74-4d51-8d9e-ceb547447e93', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841c5b5a-899c-4d93-a29e-2387b443e748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:14 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 (65a0125a-4f74-4d51-8d9e-ceb547447e93): created successfully Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841c5b5a-899c-4d93-a29e-2387b443e748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (920da0f1-b43a-40fe-9ba6-3b1532747b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:14 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c4b451b9-bdfd-4bb2-ab47-a2b08bd8b0c5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created volume successfully. Sep 01 02:10:15 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c1d64985-3b1f-48c2-a6ff-63101313e4c9" returned: 0 in 0.313s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-c1d64985-3b1f-48c2-a6ff-63101313e4c9" released by "delete_volume" :: held 1.040s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['97d0055d-178d-4aca-8b99-b7fbfe5adf75'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:15 devstack cinder-volume[87404]: WARNING cinder.quota [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1076959836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1076959836, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:10:15 devstack cinder-volume[87404]: WARNING cinder.quota [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1076959836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1076959836, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['4a8a2b79-a25c-4353-829a-f9ab015508ab', '12b48db8-fca9-4bdf-adf5-211c2312c260', '532ebcad-ecef-4ab5-8a48-870cae0a25e4', 'a5a37712-492c-49bb-adfd-a5894272b739'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:15 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:15 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:15 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot aec2f338-0d22-4194-aa95-8b68ca014bb9: deleting Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot aec2f338-0d22-4194-aa95-8b68ca014bb9: deleting {{(pid=87404) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-365ba5a8-c116-4b60-834d-e1817c3f8246" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-365ba5a8-c116-4b60-834d-e1817c3f8246" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Deleting offline snapshot 365ba5a8-c116-4b60-834d-e1817c3f8246 of volume e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] snapshot_file for this snap is: volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:15 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.392s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:15 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ae8e25f2-b081-44c0-958d-c657c584a2ed tempest-GroupSnapshotsTest-1351629572 None] Delete group completed successfully. Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[83487af8-583f-4826-95ef-ada89c5f5e63]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:15 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 Sep 01 02:10:15 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:16 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246" returned: 0 in 0.549s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4237a968-dd23-49d4-be4e-5fdc38e99017]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (94aa16df-fd67-4cdc-8c75-72ad9fccc348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c732ad-20be-4352-971a-1f6c176dcef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c732ad-20be-4352-971a-1f6c176dcef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004107180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a470c0f-b1c5-473d-9e6c-1a704a3e04b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:16Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f93a6cc-0358-47de-a419-dc81b78d6eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f93a6cc-0358-47de-a419-dc81b78d6eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47fc0d5-6935-4ee8-abad-c1c68a5ea0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47fc0d5-6935-4ee8-abad-c1c68a5ea0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a470c0f-b1c5-473d-9e6c-1a704a3e04b8', 'volume_name': 'volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b03446-0f88-42a4-aeb1-791ce58b5589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b03446-0f88-42a4-aeb1-791ce58b5589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215deef7-3e53-4a3c-8032-669d6a90940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:16 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume 8a470c0f-b1c5-473d-9e6c-1a704a3e04b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8', 'volume_size': 1} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004107180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a470c0f-b1c5-473d-9e6c-1a704a3e04b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:16Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Creating volume 8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:16 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:16 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a Sep 01 02:10:16 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:16 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 1073741824 Sep 01 02:10:16 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (dc39e1ec-552e-43cf-9b3c-6bece4689b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:17 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8a879b-e6eb-448c-a17a-b2ae51f9e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 1073741824" returned: 0 in 0.704s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8a879b-e6eb-448c-a17a-b2ae51f9e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1734700267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf6e07b-d9a4-468d-ae9a-5e211704ad3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:17Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cdbf07-444d-4b0a-9570-3467203a7bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cdbf07-444d-4b0a-9570-3467203a7bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30073395-ad48-4cba-954e-0be159987268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30073395-ad48-4cba-954e-0be159987268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf6e07b-d9a4-468d-ae9a-5e211704ad3c', 'volume_name': 'volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae68762-979e-4bef-83e7-2c767d9474b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae68762-979e-4bef-83e7-2c767d9474b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:17 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe64e5f6-fb83-46c7-96eb-1ea16a07813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume 9cf6e07b-d9a4-468d-ae9a-5e211704ad3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c', 'volume_size': 1} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" returned: 0 in 1.003s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:17 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 Sep 01 02:10:17 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:17 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 Sep 01 02:10:17 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (0ac44d66-6743-4d9b-adc9-482c4d46c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6e174c-3af5-481a-928e-747b9451ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6e174c-3af5-481a-928e-747b9451ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990994576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:18Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae45150-7e44-48ee-92f0-af2b4cd0d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae45150-7e44-48ee-92f0-af2b4cd0d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:17 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf7d499-f9f4-4fd0-b210-d2ad01043fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf7d499-f9f4-4fd0-b210-d2ad01043fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a', 'volume_name': 'volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cce4e6-edaa-4af3-869e-07b7d0fa1ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cce4e6-edaa-4af3-869e-07b7d0fa1ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0412ea26-b695-401e-b42e-f9856a4a0e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume 7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a', 'volume_size': 1} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8" returned: 0 in 0.652s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246" returned: 0 in 0.708s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1734700267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf6e07b-d9a4-468d-ae9a-5e211704ad3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:17Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Creating volume 9cf6e07b-d9a4-468d-ae9a-5e211704ad3c {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:18 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:18 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246 Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215deef7-3e53-4a3c-8032-669d6a90940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dc5828-2f4b-4aaa-83f5-85991f9a84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c 1073741824 Sep 01 02:10:18 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 (8a470c0f-b1c5-473d-9e6c-1a704a3e04b8): created successfully Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dc5828-2f4b-4aaa-83f5-85991f9a84d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (94aa16df-fd67-4cdc-8c75-72ad9fccc348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-56c1f0b0-6f4d-4909-87fb-e87994da240f tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created volume successfully. Sep 01 02:10:18 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a.365ba5a8-c116-4b60-834d-e1817c3f8246" returned: 0 in 0.503s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-365ba5a8-c116-4b60-834d-e1817c3f8246" released by "_delete_snapshot" :: held 2.975s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (12db44ee-fd89-4f25-bd8f-5d7497fc507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c24060-3a7c-4e53-866a-299ad4fdfe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" released by "delete_snapshot" :: held 3.075s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c24060-3a7c-4e53-866a-299ad4fdfe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1252016041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f34e6bd-99ac-449b-8f5c-25c0844c2707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:18Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7138284b-8f50-4fb3-afed-2fc08ebd12cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7138284b-8f50-4fb3-afed-2fc08ebd12cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397568b1-ebe6-4f01-8a65-fe275108bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397568b1-ebe6-4f01-8a65-fe275108bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f34e6bd-99ac-449b-8f5c-25c0844c2707', 'volume_name': 'volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedf68b6-c153-4a09-bb9b-c331f35f6274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedf68b6-c153-4a09-bb9b-c331f35f6274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0b507a-ed15-4ad9-bcf6-252fd3e0faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume 7f34e6bd-99ac-449b-8f5c-25c0844c2707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707', 'volume_size': 1} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:18 devstack cinder-volume[87404]: WARNING cinder.quota [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1076959836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1076959836, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['9cddfc73-d9e5-432f-843b-383d91f4821c', 'ef3b1085-e3ea-4a02-8fd7-4c20d1d0299d', '0d57d4d8-92ca-4761-8062-a06c2d58609b', 'dc451136-885a-4aef-9b07-efd0f1dc45e2'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c 1073741824" returned: 0 in 0.825s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:18 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c Sep 01 02:10:19 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:19 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-552d897e-3e59-40c7-a022-8e5bd2b7d1e5 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot aec2f338-0d22-4194-aa95-8b68ca014bb9: deleted successfully Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (dc818c15-2e56-4a98-98c5-d3fe7c9cbb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d494cb64-9c9a-4058-a8db-93cbe61b40a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d494cb64-9c9a-4058-a8db-93cbe61b40a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718635363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba3dde9-f24c-48af-9d01-c854c1f5cf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:19Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b142532-0de9-45df-8f4a-4c0237db2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b142532-0de9-45df-8f4a-4c0237db2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211b0ad9-df2f-45fa-a98f-27e440c9d44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:19 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211b0ad9-df2f-45fa-a98f-27e440c9d44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba3dde9-f24c-48af-9d01-c854c1f5cf1b', 'volume_name': 'volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bd7915-7c48-4977-b686-658a2b84b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bd7915-7c48-4977-b686-658a2b84b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fc93e0-5eac-4abe-9d7c-18c3bd9f2b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume bba3dde9-f24c-48af-9d01-c854c1f5cf1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b', 'volume_size': 1} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c" returned: 0 in 0.756s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990994576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:18Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Creating volume 7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:19 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe64e5f6-fb83-46c7-96eb-1ea16a07813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0529362f-871e-4c58-ada5-4d95a402262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:19 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a 1073741824 Sep 01 02:10:19 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c (9cf6e07b-d9a4-468d-ae9a-5e211704ad3c): created successfully Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0529362f-871e-4c58-ada5-4d95a402262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (dc39e1ec-552e-43cf-9b3c-6bece4689b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:19 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-3b77e534-9d0a-46e8-beec-266eb820ae5e tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created volume successfully. Sep 01 02:10:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:20 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" acquired by "delete_volume" :: waited 0.044s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a 1073741824" returned: 0 in 1.200s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a8082f-ba1a-4999-8c83-3e96ac34a627]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a Sep 01 02:10:21 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:21 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a Sep 01 02:10:21 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:21 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a" returned: 0 in 0.428s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1252016041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f34e6bd-99ac-449b-8f5c-25c0844c2707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:18Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Creating volume 7f34e6bd-99ac-449b-8f5c-25c0844c2707 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:21 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0412ea26-b695-401e-b42e-f9856a4a0e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:21 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 1073741824 Sep 01 02:10:21 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1ddf62-ae58-477a-b246-80dc432ad724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a (7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a): created successfully Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1ddf62-ae58-477a-b246-80dc432ad724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (0ac44d66-6743-4d9b-adc9-482c4d46c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:21 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" returned: 0 in 0.712s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-64ef9267-4dea-4d95-b454-1cc43e042942 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created volume successfully. Sep 01 02:10:21 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a Sep 01 02:10:21 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" returned: 0 in 0.553s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-e13d6294-6c7d-4df3-bdd0-5dd9e81b069a" released by "delete_volume" :: held 1.433s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['ecc5f1f2-ba1c-4d43-aa06-d3b86c2b896d'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:22 devstack cinder-volume[87404]: WARNING cinder.db.api [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1076959836'] Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['239b4d24-4d69-46bb-ad15-98936a181504', '9ea80b26-928b-4ae7-9b78-32c6e1775bc8', 'c8b11c2d-a07f-4fd3-96a2-88a92f261d53', '655c3f8a-c7e1-4b89-92d5-1792c55b8cc4'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:22 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 1073741824" returned: 0 in 1.040s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:22 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 Sep 01 02:10:22 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:22 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:22 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707" returned: 0 in 0.351s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.248s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718635363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba3dde9-f24c-48af-9d01-c854c1f5cf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072a9eca948d4eab904d540fa6b1c8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:19Z,use_quota=True,user_id='1441fc4dc3bc4cd7b265a82fe70c8458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Creating volume bba3dde9-f24c-48af-9d01-c854c1f5cf1b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:23 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0b507a-ed15-4ad9-bcf6-252fd3e0faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaba145-cc8e-4412-aa45-ed2d1152ab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:23 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b 1073741824 Sep 01 02:10:23 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:23 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 (7f34e6bd-99ac-449b-8f5c-25c0844c2707): created successfully Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaba145-cc8e-4412-aa45-ed2d1152ab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (12db44ee-fd89-4f25-bd8f-5d7497fc507b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-611d28ee-02d6-40b5-a4fb-ac549c17fbe9 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created volume successfully. Sep 01 02:10:23 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.462s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dad5ff57-b86d-4342-bc1a-854421839143 tempest-GroupSnapshotsTest-1351629572 None] Delete group completed successfully. Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7cb023a6-8332-4ace-b1e4-bdecb7dfa692 tempest-VolumesActionsTest-1076223932 None] Acquiring lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" by "attach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7cb023a6-8332-4ace-b1e4-bdecb7dfa692 tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" acquired by "attach_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7cb023a6-8332-4ace-b1e4-bdecb7dfa692 tempest-VolumesActionsTest-1076223932 None] Attaching volume 6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb to instance 5b4a73cf-980d-4c38-9b35-918d9ffc1478 at mountpoint /dev/vdb on host None. Sep 01 02:10:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7cb023a6-8332-4ace-b1e4-bdecb7dfa692 tempest-VolumesActionsTest-1076223932 None] Attach volume completed successfully. Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7cb023a6-8332-4ace-b1e4-bdecb7dfa692 tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" released by "attach_volume" :: held 0.153s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:23 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b 1073741824" returned: 0 in 0.887s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:24 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b Sep 01 02:10:24 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6faa49d9-ceb0-4bb9-bfd8-424c48e5f29c tempest-VolumesActionsTest-1076223932 None] Acquiring lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-detach_volume" by "detach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6faa49d9-ceb0-4bb9-bfd8-424c48e5f29c tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6faa49d9-ceb0-4bb9-bfd8-424c48e5f29c tempest-VolumesActionsTest-1076223932 None] Detaching volume 6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb from instance 5b4a73cf-980d-4c38-9b35-918d9ffc1478. Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6faa49d9-ceb0-4bb9-bfd8-424c48e5f29c tempest-VolumesActionsTest-1076223932 None] Detach volume completed successfully. Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6faa49d9-ceb0-4bb9-bfd8-424c48e5f29c tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-detach_volume" released by "detach_volume" :: held 0.210s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1b6f96df-ace0-4a97-a4e1-5942854613f7 tempest-GroupSnapshotsTest-1351629572 None] Group tempest-GroupSnapshotsTest-Group-1159768677: creating Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1b6f96df-ace0-4a97-a4e1-5942854613f7 tempest-GroupSnapshotsTest-1351629572 None] Group tempest-GroupSnapshotsTest-Group-1159768677: created successfully Sep 01 02:10:24 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1b6f96df-ace0-4a97-a4e1-5942854613f7 tempest-GroupSnapshotsTest-1351629572 None] Create group completed successfully. Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fc93e0-5eac-4abe-9d7c-18c3bd9f2b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181c685f-e148-4d0b-bd45-10a0bbd5eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Volume volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b (bba3dde9-f24c-48af-9d01-c854c1f5cf1b): created successfully Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181c685f-e148-4d0b-bd45-10a0bbd5eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Flow 'volume_create_manager' (dc818c15-2e56-4a98-98c5-d3fe7c9cbb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-986b6dc8-4c0e-4136-8699-5ac88ba454d5 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created volume successfully. Sep 01 02:10:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-bba3dde9-f24c-48af-9d01-c854c1f5cf1b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-bba3dde9-f24c-48af-9d01-c854c1f5cf1b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-quobyte-bba3dde9-f24c-48af-9d01-c854c1f5cf1b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-bba3dde9-f24c-48af-9d01-c854c1f5cf1b" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df993d2-423d-4dc6-9247-0258031f1477]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:26 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b Sep 01 02:10:26 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (cf0e91e8-b0b8-4d27-96f6-c86c17b3b7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366925b8-b2bf-4ca2-83ff-3271640df728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366925b8-b2bf-4ca2-83ff-3271640df728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-677386734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9605556f-7d70-4793-9fd3-284e7bc07a78,host='devstack@QuobyteHD#QuobyteHD',id=16b3d41d-c39b-4f9d-9c88-987418bcda1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:26Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6022d0-2cce-4a36-a6d6-462be43e9825),volume_type_id=0c6022d0-2cce-4a36-a6d6-462be43e9825)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2bbc97-c902-4404-b9a5-85b74870ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2bbc97-c902-4404-b9a5-85b74870ae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188233e0-8700-479c-8e0b-05c2403dd752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188233e0-8700-479c-8e0b-05c2403dd752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b3d41d-c39b-4f9d-9c88-987418bcda1a', 'volume_name': 'volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280b2575-8ccd-4125-8edd-7fd5572f0bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280b2575-8ccd-4125-8edd-7fd5572f0bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c15aa92-4578-49d4-a107-a6c2fa43f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Volume 16b3d41d-c39b-4f9d-9c88-987418bcda1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a', 'volume_size': 1} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9605556f-7d70-4793-9fd3-284e7bc07a78,created_at=2026-09-01T00:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-677386734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9605556f-7d70-4793-9fd3-284e7bc07a78,host='devstack@QuobyteHD#QuobyteHD',id=16b3d41d-c39b-4f9d-9c88-987418bcda1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:26Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6022d0-2cce-4a36-a6d6-462be43e9825),volume_type_id=0c6022d0-2cce-4a36-a6d6-462be43e9825)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Creating volume 16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:26 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:26 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b" returned: 0 in 0.662s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:26 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a 1073741824 Sep 01 02:10:26 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:26 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b Sep 01 02:10:26 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:27 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bba3dde9-f24c-48af-9d01-c854c1f5cf1b" returned: 0 in 0.482s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-bba3dde9-f24c-48af-9d01-c854c1f5cf1b" released by "delete_volume" :: held 1.222s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created reservations ['134c0561-5c94-42d8-a40b-f52255abbe95', '98d75414-9ec2-48ab-8170-847b3e24fd89', '8feac03d-93c3-4a5d-87c7-a19e5937c269', '941e9a86-bde3-451e-a2d7-1af8586176a0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:27 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a 1073741824" returned: 0 in 0.752s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:27 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:27 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:27 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a Sep 01 02:10:27 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:27 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.360s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Deleted volume successfully. Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e3c67268-6a81-46e8-9814-7c9608683dfe tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-bba3dde9-f24c-48af-9d01-c854c1f5cf1b-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:27 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a" returned: 0 in 0.436s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c15aa92-4578-49d4-a107-a6c2fa43f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dd9d20-1042-47c5-ab2a-713903767eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:27 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Volume volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a (16b3d41d-c39b-4f9d-9c88-987418bcda1a): created successfully Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dd9d20-1042-47c5-ab2a-713903767eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (cf0e91e8-b0b8-4d27-96f6-c86c17b3b7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2450abfc-ff01-4a00-95e9-39d9cfcdd1ef tempest-GroupSnapshotsTest-1351629572 None] Created volume successfully. Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-7f34e6bd-99ac-449b-8f5c-25c0844c2707-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-7f34e6bd-99ac-449b-8f5c-25c0844c2707-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-quobyte-7f34e6bd-99ac-449b-8f5c-25c0844c2707" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-7f34e6bd-99ac-449b-8f5c-25c0844c2707" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4465f6-7b1c-41fe-93f2-b9b0bb24ad25]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:28 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 Sep 01 02:10:28 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:28 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:28 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:28 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707" returned: 0 in 0.464s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:28 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707 Sep 01 02:10:28 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:28 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.385s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:10:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:10:29 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7f34e6bd-99ac-449b-8f5c-25c0844c2707" returned: 0 in 0.407s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-7f34e6bd-99ac-449b-8f5c-25c0844c2707" released by "delete_volume" :: held 0.954s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created reservations ['9c567209-7cbd-4b21-96ee-fcb1db57f896', '1b394d0e-097c-4935-bf43-b6c7ee8c741c', 'f5e5342f-f8b1-4621-bddb-ebaeae88615c', '478ce1b6-deb0-401f-9499-8b1627aeec39'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:29 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:29 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:29 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (afa93452-3977-44c8-ac3f-2adf297b579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a726b7a3-1e42-44ac-a11e-7beeb4cb4294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.421s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a726b7a3-1e42-44ac-a11e-7beeb4cb4294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1618516737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9605556f-7d70-4793-9fd3-284e7bc07a78,host='devstack@QuobyteHD#QuobyteHD',id=373d95f8-896c-4947-a6fe-e189a208b905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:30Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6022d0-2cce-4a36-a6d6-462be43e9825),volume_type_id=0c6022d0-2cce-4a36-a6d6-462be43e9825)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f715417b-c655-4115-823b-aa1ec31c42ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f715417b-c655-4115-823b-aa1ec31c42ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acff0d29-13a8-4629-8696-b5c03fd795ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acff0d29-13a8-4629-8696-b5c03fd795ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373d95f8-896c-4947-a6fe-e189a208b905', 'volume_name': 'volume-373d95f8-896c-4947-a6fe-e189a208b905', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06884838-83a1-46e6-8e3c-1700e56c98b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06884838-83a1-46e6-8e3c-1700e56c98b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067134c7-842e-44f5-9e0b-a5cbc4b460a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Volume 373d95f8-896c-4947-a6fe-e189a208b905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373d95f8-896c-4947-a6fe-e189a208b905', 'volume_size': 1} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9605556f-7d70-4793-9fd3-284e7bc07a78,created_at=2026-09-01T00:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1618516737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9605556f-7d70-4793-9fd3-284e7bc07a78,host='devstack@QuobyteHD#QuobyteHD',id=373d95f8-896c-4947-a6fe-e189a208b905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:30Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6022d0-2cce-4a36-a6d6-462be43e9825),volume_type_id=0c6022d0-2cce-4a36-a6d6-462be43e9825)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Creating volume 373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:29 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:10:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Deleted volume successfully. Sep 01 02:10:30 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 1073741824 Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:30 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9bb2ddcd-9cc3-495b-80ea-0b897d970068 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-7f34e6bd-99ac-449b-8f5c-25c0844c2707-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-quobyte-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1ae53a-9660-4413-816e-e670b6722a54]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a Sep 01 02:10:30 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:30 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 1073741824" returned: 0 in 0.667s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:30 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a" returned: 0 in 0.513s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:30 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a Sep 01 02:10:30 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 Sep 01 02:10:30 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:30 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:30 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a" released by "delete_volume" :: held 0.891s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905" returned: 0 in 0.315s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.637s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067134c7-842e-44f5-9e0b-a5cbc4b460a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373d95f8-896c-4947-a6fe-e189a208b905', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcf1ed3-2531-4477-8ae8-0bf2c77c4573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[713849a4-549c-4bd4-88d9-eb3bd2ba2d93]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Volume volume-373d95f8-896c-4947-a6fe-e189a208b905 (373d95f8-896c-4947-a6fe-e189a208b905): created successfully Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcf1ed3-2531-4477-8ae8-0bf2c77c4573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (afa93452-3977-44c8-ac3f-2adf297b579d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7aeddb27-1b2e-4431-992c-dffd60705bd3 tempest-GroupSnapshotsTest-1351629572 None] Created volume successfully. Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created reservations ['8c233643-ed1b-4114-bdcf-3eceea1ef66b', '93e87e10-a498-4959-886a-3e36062c7830', '733c2c46-13bb-48a6-86ec-5643342220b2', '3763fd8c-f65a-4c32-b674-d226c6c15709'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:31 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:31 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:31 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.491s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6048998-40cf-4179-8152-5f86f4cf9017]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Deleted volume successfully. Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14916b81-fe9b-4a3b-aabe-78cb3ea00d37 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-7b34fbb4-9ecc-42f6-9924-8aa59ab2ed3a-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:31 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:10:31 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:31 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.409s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.e759ae69-00a7-45f7-a863-9d8efc5fcac70r7x7qq0.img {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:32 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.e759ae69-00a7-45f7-a863-9d8efc5fcac70r7x7qq0.img Sep 01 02:10:32 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-quobyte-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-57b81e51-e333-4937-b82d-a0588265a2c9 tempest-GroupSnapshotsTest-1351629572 None] Update group completed successfully. Sep 01 02:10:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:32 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a64a3f-90e3-4ff6-bac7-699b1e837faa]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:33 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c Sep 01 02:10:33 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:33 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c" returned: 0 in 1.121s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:33 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c Sep 01 02:10:33 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9e10d1a0-b8e7-4b72-b82e-819bf76a02bf tempest-GroupSnapshotsTest-1351629572 None] Update group completed successfully. Sep 01 02:10:34 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c" returned: 0 in 0.583s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c" released by "delete_volume" :: held 1.811s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created reservations ['061a22b1-7d13-477a-930d-212de1dfd13b', '8125a21b-32e0-4c18-9ea2-81adff93a149', '9d8ff869-5106-4012-8071-7cb586df9529', '6dd7fe7a-ccd1-48e1-99b6-a312e065539c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:34 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:34 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-quobyte-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8" acquired by "delete_volume" :: waited 0.080s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[79502484-b05b-4966-a1e3-a3c021f7a790]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:35 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.920s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-40c06879-7753-47ca-a655-dc319aa86c3c tempest-GroupSnapshotsTest-1351629572 None] Update group completed successfully. Sep 01 02:10:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Deleted volume successfully. Sep 01 02:10:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-92bee9b3-f002-4a23-b910-b1702b937f32 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-9cf6e07b-d9a4-468d-ae9a-5e211704ad3c-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:35 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 Sep 01 02:10:35 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:36 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8" returned: 0 in 0.908s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:36 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8 Sep 01 02:10:36 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c3d33999-09a2-4fdb-83dc-1fe914b6e062 tempest-GroupSnapshotsTest-1351629572 None] Update group completed successfully. Sep 01 02:10:37 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.e759ae69-00a7-45f7-a863-9d8efc5fcac70r7x7qq0.img" returned: 0 in 5.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9f5c7-e350-4d6a-b61d-cef2db989f02]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:37 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8" returned: 0 in 0.827s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8" released by "delete_volume" :: held 1.863s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created reservations ['d3a346c5-7ddb-4557-a788-b2a37234f83e', '82b94a1b-afd4-4b06-a08d-35bc35acd237', '19872cd4-cc80-4c41-8ae7-3a5db949d53d', '186f030c-2e45-4741-8ae0-f22f67d94e20'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:37 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:10:37 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:37 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:37 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:37 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.267s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Deleted volume successfully. Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c5284dd2-703a-49fe-8efc-a3abe4346b24 tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-8a470c0f-b1c5-473d-9e6c-1a704a3e04b8-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-65a0125a-4f74-4d51-8d9e-ceb547447e93-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-65a0125a-4f74-4d51-8d9e-ceb547447e93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "cinder-quobyte-65a0125a-4f74-4d51-8d9e-ceb547447e93" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-65a0125a-4f74-4d51-8d9e-ceb547447e93" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:38 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.722s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.e759ae69-00a7-45f7-a863-9d8efc5fcac70r7x7qq0.img {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:38 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Converted 1024.00 MB image at 192.04 MB/s Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] e759ae69-00a7-45f7-a863-9d8efc5fcac7 was raw, no need to convert to raw {{(pid=87404) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5b4a3-0e47-41b9-b4d2-b926eeb20347]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:38 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 Sep 01 02:10:38 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:38 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93" returned: 0 in 0.459s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:38 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93 Sep 01 02:10:38 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] GroupSnapshot 92aac0c0-6696-4a29-9702-0404e14de306: creating. Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Group snapshot 92aac0c0-6696-4a29-9702-0404e14de306: creating. {{(pid=87404) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:38 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-65a0125a-4f74-4d51-8d9e-ceb547447e93" returned: 0 in 0.403s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-quobyte-65a0125a-4f74-4d51-8d9e-ceb547447e93" released by "delete_volume" :: held 0.921s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Created reservations ['1f63f5a2-a30a-400d-b1f5-e4d6712b292c', '180ca528-2e21-43e5-a1e7-73301e9a05b4', '5ad37a6c-1110-45ec-978d-dd8c8933fb7b', '13b7f101-71fb-40b6-8872-209374c3d228'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:39 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:10:39 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:39 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.453s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Deleted volume successfully. Sep 01 02:10:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4d370e34-b147-40ef-92dd-17c2b57ecd5c tempest-CreateVolumesFromSourceVolumeTest-902532442 None] Lock "cinder-65a0125a-4f74-4d51-8d9e-ceb547447e93-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Flow 'volume_create_manager' (59fd1396-c7c2-4093-b17c-b91d7c763e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8d0a16-1f3c-4faf-b215-28e90305739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8d0a16-1f3c-4faf-b215-28e90305739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3107aec-2d51-43e0-968f-b06bbea7005f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce6e6d00ed4bec92711eb54e53cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:45Z,use_quota=True,user_id='c291d7d7d6874d71b4ed4be00b92e5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea736ee-c8f5-4318-a7e7-68be54b45631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea736ee-c8f5-4318-a7e7-68be54b45631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d44a1f7-0046-4fe6-9c5f-6e139fbe7749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d44a1f7-0046-4fe6-9c5f-6e139fbe7749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3107aec-2d51-43e0-968f-b06bbea7005f', 'volume_name': 'volume-c3107aec-2d51-43e0-968f-b06bbea7005f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3d81e-b804-4ebf-b592-cc6e3eddb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3d81e-b804-4ebf-b592-cc6e3eddb73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6fdd65-a388-429d-b631-152cbfeb6830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:45 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Volume c3107aec-2d51-43e0-968f-b06bbea7005f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3107aec-2d51-43e0-968f-b06bbea7005f', 'volume_size': 1} Sep 01 02:10:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:55 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=127,cinder:SELECT=113,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:55 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=105,cinder:SELECT=94,cinder:INSERT=28,cinder:DELETE=5 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Flow 'volume_create_manager' (988bb826-28f4-428f-bc9a-89119e3ffd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac4e06d-dc9b-414e-9a51-08265cedf772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac4e06d-dc9b-414e-9a51-08265cedf772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-875805442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1495cda-abba-4bc8-9993-436a6b3c9d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2d8346ab5047edb1ff6a0260ae2695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:58Z,use_quota=True,user_id='12afce9b9b4d4af8a760ceadad2633b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c9f86f-e7ad-4c7b-8418-52e99a44e87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c9f86f-e7ad-4c7b-8418-52e99a44e87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88bb1f0-f44a-4278-9143-a6f1664ff05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88bb1f0-f44a-4278-9143-a6f1664ff05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1495cda-abba-4bc8-9993-436a6b3c9d1b', 'volume_name': 'volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb54c6c-f0ee-4850-9c94-ca47902912c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb54c6c-f0ee-4850-9c94-ca47902912c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45788c9a-25ca-467f-b981-3443a95b4fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:58 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Volume d1495cda-abba-4bc8-9993-436a6b3c9d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b', 'volume_size': 1} Sep 01 02:10:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.343s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Uploaded volume to glance image-id: e759ae69-00a7-45f7-a863-9d8efc5fcac7. {{(pid=87404) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 22.494s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Creating offline snapshot 281f296a-a700-4086-83aa-c7a5e9648a6b of volume 16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1d2c28c0-af5b-4375-8f35-be7f74e75c9b tempest-VolumesActionsTest-1076223932 None] Copy volume to image completed successfully. Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd143e7-0570-4780-b2a6-6b95e4ab78f6]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a Sep 01 02:11:01 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a" returned: 0 in 0.361s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b 1G Sep 01 02:11:01 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b 1G" returned: 0 in 0.470s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b Sep 01 02:11:02 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b" returned: 0 in 0.342s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b Sep 01 02:11:02 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b" returned: 0 in 0.263s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info Sep 01 02:11:02 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:03 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:03 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:03 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info Sep 01 02:11:03 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:03 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.info" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Creating offline snapshot a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 of volume 373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f48a3-0453-49ca-b8fc-b3d979f0e5e0]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:03 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 Sep 01 02:11:03 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:03 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905" returned: 0 in 0.409s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:03 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 1G Sep 01 02:11:03 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 1G" returned: 0 in 0.444s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373d95f8-896c-4947-a6fe-e189a208b905 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:04 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373d95f8-896c-4947-a6fe-e189a208b905 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 Sep 01 02:11:04 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373d95f8-896c-4947-a6fe-e189a208b905 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" returned: 0 in 0.289s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:04 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:11:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:04 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 Sep 01 02:11:04 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" returned: 0 in 0.255s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:05 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info Sep 01 02:11:05 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:05 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:05 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:05 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info Sep 01 02:11:05 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:05 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.info" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.410s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-875805442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1495cda-abba-4bc8-9993-436a6b3c9d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2d8346ab5047edb1ff6a0260ae2695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:58Z,use_quota=True,user_id='12afce9b9b4d4af8a760ceadad2633b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Creating volume d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:05 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:05 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b 1073741824 Sep 01 02:11:05 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-07b6b96e-68a8-4810-8acc-738340f4e576 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 92aac0c0-6696-4a29-9702-0404e14de306: created successfully Sep 01 02:11:06 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b 1073741824" returned: 0 in 0.575s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:06 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b Sep 01 02:11:06 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 92aac0c0-6696-4a29-9702-0404e14de306: deleting Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 92aac0c0-6696-4a29-9702-0404e14de306: deleting {{(pid=87404) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-16b3d41d-c39b-4f9d-9c88-987418bcda1a" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-16b3d41d-c39b-4f9d-9c88-987418bcda1a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-281f296a-a700-4086-83aa-c7a5e9648a6b" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-281f296a-a700-4086-83aa-c7a5e9648a6b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Deleting offline snapshot 281f296a-a700-4086-83aa-c7a5e9648a6b of volume 16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] snapshot_file for this snap is: volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3497c9db-b5d2-4aa8-908e-20c47c618777]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b Sep 01 02:11:07 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:07 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b" returned: 0 in 0.338s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.060s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45788c9a-25ca-467f-b981-3443a95b4fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2bc49f-5a66-430a-bb1e-89d496f4783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02769f1-349b-4f17-9ec6-30bf4b96db48]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Volume volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b (d1495cda-abba-4bc8-9993-436a6b3c9d1b): created successfully Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2bc49f-5a66-430a-bb1e-89d496f4783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Flow 'volume_create_manager' (988bb826-28f4-428f-bc9a-89119e3ffd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f06da6b4-2b97-417d-81da-999bc8c6d874 tempest-TestImageHashVerification-1268977626 None] Created volume successfully. Sep 01 02:11:07 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:11:07 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:07 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b" returned: 0 in 0.414s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f2f98-d47f-4ed4-9878-5eec72fe3d0a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a Sep 01 02:11:07 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:07 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde30d9c-36d1-4156-8f6d-d0efa6a9e8a9]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:11:07 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:07 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a" returned: 0 in 0.435s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b Sep 01 02:11:07 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.472s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:08 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img Sep 01 02:11:08 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b" returned: 0 in 0.459s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:08 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b Sep 01 02:11:08 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a.281f296a-a700-4086-83aa-c7a5e9648a6b" returned: 0 in 0.350s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-281f296a-a700-4086-83aa-c7a5e9648a6b" released by "_delete_snapshot" :: held 1.855s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-16b3d41d-c39b-4f9d-9c88-987418bcda1a" released by "delete_snapshot" :: held 1.892s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-373d95f8-896c-4947-a6fe-e189a208b905" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-373d95f8-896c-4947-a6fe-e189a208b905" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Deleting offline snapshot a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 of volume 373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] snapshot_file for this snap is: volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc6a9e-0921-4d07-848a-a4b16d109456]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:09 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 Sep 01 02:11:09 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:09 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" returned: 0 in 0.831s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-373d95f8-896c-4947-a6fe-e189a208b905(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d5a211-9bec-4a08-8461-803a0a424a75]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:10 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 Sep 01 02:11:10 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:10 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905" returned: 0 in 0.827s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:10 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 Sep 01 02:11:10 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:11 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" returned: 0 in 0.861s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:11 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90 Sep 01 02:11:11 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:12 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905.a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" returned: 0 in 0.571s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-a9a43b4d-0ae2-4d37-939d-7d4920b8ea90" released by "_delete_snapshot" :: held 3.339s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-373d95f8-896c-4947-a6fe-e189a208b905" released by "delete_snapshot" :: held 3.406s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:12 devstack cinder-volume[87404]: WARNING cinder.quota [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-955075685 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-955075685, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:12 devstack cinder-volume[87404]: WARNING cinder.quota [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-955075685 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-955075685, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['8d723cf7-83b0-4a12-a612-bf4ca50f9784', 'fd1db50d-bcfe-4bee-a140-4bb91322e60b', 'd849c362-2e02-4595-b66f-4beae56dfe0f', 'f198ee46-9885-473b-af53-3cd2dd79759c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['143a0e7d-ee17-4569-b237-873b90379faa', 'e2bd6340-c516-428e-bdfb-ddd56d876220', 'f653778a-603a-4d9f-924b-4a95a7d1edbe', '801aafff-7d2b-403d-93c5-f7ff16559b8f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-376ceb34-7440-4c99-a681-70b29835cbf3 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 92aac0c0-6696-4a29-9702-0404e14de306: deleted successfully Sep 01 02:11:12 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img" returned: 0 in 4.806s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28be51-e1ec-4818-a73c-09226ca0a607]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:12 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:11:12 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.548s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:13 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Converted 1024.00 MB image at 213.04 MB/s Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] a2cae48f-308c-437e-8b76-bae132d72989 was raw, converting to qcow2 {{(pid=87404) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaedaf2-6944-4ac7-848b-d3ac1687f512]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img Sep 01 02:11:13 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:13 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img" returned: 0 in 0.338s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:13 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img Sep 01 02:11:13 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-16b3d41d-c39b-4f9d-9c88-987418bcda1a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:14 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-16b3d41d-c39b-4f9d-9c88-987418bcda1a" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img" returned: 1 in 0.388s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img /opt/stack/data/cinder/conversion/vol_upload_fdziao76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081abcb-c8d2-47a3-bd9b-3826cc54cfcc]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img /opt/stack/data/cinder/conversion/vol_upload_fdziao76 Sep 01 02:11:14 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a Sep 01 02:11:14 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img /opt/stack/data/cinder/conversion/vol_upload_fdziao76" returned: 0 in 0.380s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Image conversion details: src /opt/stack/data/cinder/conversion/6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb.temp_image.a2cae48f-308c-437e-8b76-bae132d729896_7x1_i3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fdziao76 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:14 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12c73e-5413-44f8-b35b-d7ce0895d0d2]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fdziao76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a" returned: 0 in 0.436s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:14 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a Sep 01 02:11:14 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fdziao76 Sep 01 02:11:14 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:14 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-16b3d41d-c39b-4f9d-9c88-987418bcda1a" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-16b3d41d-c39b-4f9d-9c88-987418bcda1a" released by "delete_volume" :: held 0.836s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-373d95f8-896c-4947-a6fe-e189a208b905" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fdziao76" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-373d95f8-896c-4947-a6fe-e189a208b905" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7519e5c-210f-4206-ae63-095b2a59db03]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 Sep 01 02:11:15 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905" returned: 0 in 0.398s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:15 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905 Sep 01 02:11:15 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:15 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-373d95f8-896c-4947-a6fe-e189a208b905" returned: 0 in 0.282s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-373d95f8-896c-4947-a6fe-e189a208b905" released by "delete_volume" :: held 0.741s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['7a68fbee-4b92-4d5d-b94f-293f2bd38756'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:15 devstack cinder-volume[87404]: WARNING cinder.quota [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-955075685 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-955075685, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['726db38b-a4ec-4ada-8794-c2ac0cd988ce', '87dcd0f0-e8cc-469e-a7e0-8dba33eb737c', 'd4eadf09-b4de-4c6d-a0b1-ccb92475f3bb', 'b997c185-fa03-476c-92fa-07fa54cfa060'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['aacab17c-e1f7-47cd-a006-e756834a5c69', '07af3b44-9ae3-42a8-bc47-50085a1c17c1', 'a3c4ee54-ab05-47ee-90ab-537d3a103232', 'e9549e58-4762-475b-ae66-0129fc1df5cd'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:16 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.276s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ae203950-3725-4f75-9590-f4c380091aa0 tempest-GroupSnapshotsTest-1351629572 None] Delete group completed successfully. Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.548s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Uploaded volume to glance image-id: a2cae48f-308c-437e-8b76-bae132d72989. {{(pid=87404) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.905s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3107aec-2d51-43e0-968f-b06bbea7005f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce6e6d00ed4bec92711eb54e53cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:45Z,use_quota=True,user_id='c291d7d7d6874d71b4ed4be00b92e5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Creating volume c3107aec-2d51-43e0-968f-b06bbea7005f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:16 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:16 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f 1073741824 Sep 01 02:11:16 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dbf0e9b3-c2a7-45d3-a0c0-3f42d5a465d9 tempest-VolumesActionsTest-1076223932 None] Copy volume to image completed successfully. Sep 01 02:11:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8a9667f4-faf4-472f-a6b6-a1989d4b1652 tempest-GroupSnapshotsTest-1351629572 None] Group tempest-GroupSnapshotsTest-Group-144009621: creating Sep 01 02:11:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8a9667f4-faf4-472f-a6b6-a1989d4b1652 tempest-GroupSnapshotsTest-1351629572 None] Group tempest-GroupSnapshotsTest-Group-144009621: created successfully Sep 01 02:11:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8a9667f4-faf4-472f-a6b6-a1989d4b1652 tempest-GroupSnapshotsTest-1351629572 None] Create group completed successfully. Sep 01 02:11:17 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f 1073741824" returned: 0 in 0.590s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f Sep 01 02:11:17 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Acquiring lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f" returned: 0 in 0.269s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.509s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6fdd65-a388-429d-b631-152cbfeb6830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3107aec-2d51-43e0-968f-b06bbea7005f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaf9996-bef6-42e3-ba21-9122c248f25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11d771-b275-4411-a8cc-8769db3c5f42]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Volume volume-c3107aec-2d51-43e0-968f-b06bbea7005f (c3107aec-2d51-43e0-968f-b06bbea7005f): created successfully Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaf9996-bef6-42e3-ba21-9122c248f25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Flow 'volume_create_manager' (59fd1396-c7c2-4093-b17c-b91d7c763e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ffc8c559-983f-4ece-a482-a09da537f955 tempest-CinderUnicodeTest-2097448618 None] Created volume successfully. Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Acquiring lock "cinder-quobyte-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Lock "cinder-quobyte-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a666d-91a7-4a63-af10-394bb67652d8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:17 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b Sep 01 02:11:17 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:11:17 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:17 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d319cc4-8138-426b-a427-7bd3d613bed6]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.362s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb Sep 01 02:11:18 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b Sep 01 02:11:18 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" returned: 0 in 0.290s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Lock "cinder-quobyte-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb" released by "delete_volume" :: held 0.694s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:18 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b" returned: 0 in 0.453s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b /opt/stack/data/cinder/conversion/d1495cda-abba-4bc8-9993-436a6b3c9d1b.temp_image.56d71022-ab06-4f8d-b783-5ff4c84fade6x30uetf2.img {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Created reservations ['c4f32402-9c76-468d-8679-d8df1d79e051', '424d672e-bf6c-4ec1-b189-8d1d19cbfd15', '267b9f54-3611-436f-8853-f891926719f4', '1b33af0d-a974-4c0e-9fba-2a54e495e0d4'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:18 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b /opt/stack/data/cinder/conversion/d1495cda-abba-4bc8-9993-436a6b3c9d1b.temp_image.56d71022-ab06-4f8d-b783-5ff4c84fade6x30uetf2.img Sep 01 02:11:18 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:18 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:18 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:19 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.554s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:19 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Deleted volume successfully. Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38625900-8a5f-4586-bdde-0301ef6871fd tempest-VolumesActionsTest-1076223932 None] Lock "cinder-6e4dc7b6-1d92-4adb-96fb-43afa84ec2bb-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (0780dd8c-cc3d-4792-adb0-09974f16b919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361fdcec-73bb-4f74-8c30-baeb7b21fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361fdcec-73bb-4f74-8c30-baeb7b21fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441890707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df975ef1-ebcc-4a10-a773-5a40b108c935,host='devstack@QuobyteHD#QuobyteHD',id=982e8acc-6b32-4053-a63b-a73c3cf46a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:19Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99eb05c5-e8a1-4556-8f41-445fddfd0d5f),volume_type_id=99eb05c5-e8a1-4556-8f41-445fddfd0d5f)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705a6dfd-7b56-495a-a277-f4b501d3360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705a6dfd-7b56-495a-a277-f4b501d3360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b4c92c-ef07-4ce5-98ea-366cc2b3e7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b4c92c-ef07-4ce5-98ea-366cc2b3e7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982e8acc-6b32-4053-a63b-a73c3cf46a14', 'volume_name': 'volume-982e8acc-6b32-4053-a63b-a73c3cf46a14', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabff177-1beb-4347-a808-234852d3f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabff177-1beb-4347-a808-234852d3f11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b1427d-9dfb-4c18-8fb8-fe07f0c27200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Volume 982e8acc-6b32-4053-a63b-a73c3cf46a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982e8acc-6b32-4053-a63b-a73c3cf46a14', 'volume_size': 1} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Flow 'volume_create_manager' (a4496d3e-9706-429d-9f88-758741121b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab1e2be-3cf0-4a9b-89cc-93ae1fcbd5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab1e2be-3cf0-4a9b-89cc-93ae1fcbd5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-40496930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a93423-b8ef-4c73-9b40-4897d428bb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce6e6d00ed4bec92711eb54e53cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:19Z,use_quota=True,user_id='c291d7d7d6874d71b4ed4be00b92e5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c49caf-483c-49d2-bae3-4aaf3fd355e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c49caf-483c-49d2-bae3-4aaf3fd355e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26af34-e230-4e54-8f73-80ec5f97abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26af34-e230-4e54-8f73-80ec5f97abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a93423-b8ef-4c73-9b40-4897d428bb76', 'volume_name': 'volume-89a93423-b8ef-4c73-9b40-4897d428bb76', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed800be5-fc52-4428-b293-416af211f36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed800be5-fc52-4428-b293-416af211f36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d09ebfa-dcab-42c0-96c6-61f2361cbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:20 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Volume 89a93423-b8ef-4c73-9b40-4897d428bb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a93423-b8ef-4c73-9b40-4897d428bb76', 'volume_size': 1} Sep 01 02:11:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b /opt/stack/data/cinder/conversion/d1495cda-abba-4bc8-9993-436a6b3c9d1b.temp_image.56d71022-ab06-4f8d-b783-5ff4c84fade6x30uetf2.img" returned: 0 in 5.282s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b73ee-336d-4d38-8f0f-cd7f8d5ef4b9]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:23 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b Sep 01 02:11:23 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:24 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b" returned: 0 in 0.593s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:24 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/conversion/d1495cda-abba-4bc8-9993-436a6b3c9d1b.temp_image.56d71022-ab06-4f8d-b783-5ff4c84fade6x30uetf2.img {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:24 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Converted 1024.00 MB image at 193.84 MB/s Sep 01 02:11:24 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] 56d71022-ab06-4f8d-b783-5ff4c84fade6 was raw, no need to convert to raw {{(pid=87404) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:28 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:28 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:28 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.360s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:11:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Flow 'volume_create_manager' (2daa0daa-5838-42a7-b986-4d3ea21b996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae7fc4c-c3c2-4e44-b0a9-e75b8fe01c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae7fc4c-c3c2-4e44-b0a9-e75b8fe01c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-290900785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c44db0-5257-4a81-b341-91b98c5e0a14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144047ed94974837b28dd984e60a5142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:30Z,use_quota=True,user_id='09f3c49c82af436c90e3289d84bc2bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08420ce9-c691-4b7f-b708-2e2217df3677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08420ce9-c691-4b7f-b708-2e2217df3677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a95d586-ea15-44e9-a7b4-76610355e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a95d586-ea15-44e9-a7b4-76610355e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c44db0-5257-4a81-b341-91b98c5e0a14', 'volume_name': 'volume-58c44db0-5257-4a81-b341-91b98c5e0a14', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73541c6-5879-4199-b309-f195f49fd79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73541c6-5879-4199-b309-f195f49fd79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd38ea-cae5-4895-899f-58b6d61deb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Volume 58c44db0-5257-4a81-b341-91b98c5e0a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c44db0-5257-4a81-b341-91b98c5e0a14', 'volume_size': 1} Sep 01 02:11:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:39 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=40,cinder:UPDATE=59,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.694s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Uploaded volume to glance image-id: 56d71022-ab06-4f8d-b783-5ff4c84fade6. {{(pid=87404) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.287s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df975ef1-ebcc-4a10-a773-5a40b108c935,created_at=2026-09-01T00:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441890707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df975ef1-ebcc-4a10-a773-5a40b108c935,host='devstack@QuobyteHD#QuobyteHD',id=982e8acc-6b32-4053-a63b-a73c3cf46a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3b2a6e1b0e4468b45440db36537ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:19Z,use_quota=True,user_id='5b94a088d85747ad850a6187cb5bb3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99eb05c5-e8a1-4556-8f41-445fddfd0d5f),volume_type_id=99eb05c5-e8a1-4556-8f41-445fddfd0d5f)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Creating volume 982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:44 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:44 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 1073741824 Sep 01 02:11:44 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-3def11d2-b4f7-4604-a513-7f99c10fa900 tempest-TestImageHashVerification-1268977626 None] Copy volume to image completed successfully. Sep 01 02:11:44 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 1073741824" returned: 0 in 0.496s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:44 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 Sep 01 02:11:44 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.872s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-40496930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a93423-b8ef-4c73-9b40-4897d428bb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce6e6d00ed4bec92711eb54e53cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:19Z,use_quota=True,user_id='c291d7d7d6874d71b4ed4be00b92e5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Creating volume 89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:45 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b1427d-9dfb-4c18-8fb8-fe07f0c27200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982e8acc-6b32-4053-a63b-a73c3cf46a14', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:45 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 1073741824 Sep 01 02:11:45 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca27cf30-27bb-4654-a114-09d0120a1fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:45 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Volume volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 (982e8acc-6b32-4053-a63b-a73c3cf46a14): created successfully Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca27cf30-27bb-4654-a114-09d0120a1fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Flow 'volume_create_manager' (0780dd8c-cc3d-4792-adb0-09974f16b919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Acquiring lock "cinder-d1495cda-abba-4bc8-9993-436a6b3c9d1b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fab7a9c2-1eaa-4103-b68a-aa9351857ee0 tempest-GroupSnapshotsTest-1351629572 None] Created volume successfully. Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Lock "cinder-d1495cda-abba-4bc8-9993-436a6b3c9d1b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Acquiring lock "cinder-quobyte-d1495cda-abba-4bc8-9993-436a6b3c9d1b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Lock "cinder-quobyte-d1495cda-abba-4bc8-9993-436a6b3c9d1b" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23f1ef2-41d2-441d-9d58-df48598a2377]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b Sep 01 02:11:45 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 1073741824" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 Sep 01 02:11:45 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b" returned: 0 in 0.433s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b Sep 01 02:11:45 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76" returned: 0 in 0.302s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.144s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-290900785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c44db0-5257-4a81-b341-91b98c5e0a14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144047ed94974837b28dd984e60a5142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:30Z,use_quota=True,user_id='09f3c49c82af436c90e3289d84bc2bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Creating volume 58c44db0-5257-4a81-b341-91b98c5e0a14 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:45 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d09ebfa-dcab-42c0-96c6-61f2361cbfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a93423-b8ef-4c73-9b40-4897d428bb76', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01764435-563a-4f24-86a2-cdcf65299fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:45 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Volume volume-89a93423-b8ef-4c73-9b40-4897d428bb76 (89a93423-b8ef-4c73-9b40-4897d428bb76): created successfully Sep 01 02:11:45 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 1073741824 Sep 01 02:11:45 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01764435-563a-4f24-86a2-cdcf65299fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Flow 'volume_create_manager' (a4496d3e-9706-429d-9f88-758741121b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:45 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b827552a-08db-4d84-b450-e5345b77bcc6 tempest-CinderUnicodeTest-2097448618 None] Created volume successfully. Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1495cda-abba-4bc8-9993-436a6b3c9d1b" returned: 0 in 0.335s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Lock "cinder-quobyte-d1495cda-abba-4bc8-9993-436a6b3c9d1b" released by "delete_volume" :: held 0.824s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Created reservations ['b50fd9c9-c6ef-40a4-b06b-3e3b4e31acf6', '570bdbf7-0dec-42ba-b453-add34d237b26', '4da38952-5cba-40fb-8317-532f73b5f69e', 'f9747eca-ae08-4cac-9f95-7c22386961bb'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:46 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:46 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] GroupSnapshot 048cfa1c-e717-4970-bcbb-ece463917054: creating. Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Group snapshot 048cfa1c-e717-4970-bcbb-ece463917054: creating. {{(pid=87404) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:46 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.377s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Deleted volume successfully. Sep 01 02:11:46 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 1073741824" returned: 0 in 0.748s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f80d58ab-54c4-4dbd-a266-d1e071c37fa7 tempest-TestImageHashVerification-1268977626 None] Lock "cinder-d1495cda-abba-4bc8-9993-436a6b3c9d1b-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:46 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 Sep 01 02:11:46 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:47 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14" returned: 0 in 0.306s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.622s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd38ea-cae5-4895-899f-58b6d61deb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c44db0-5257-4a81-b341-91b98c5e0a14', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277dc4e3-1c16-4ad7-9bc8-c3d8e29579e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Creating offline snapshot 8adaf92d-244c-49a7-9139-4e7f853e80db of volume 982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Volume volume-58c44db0-5257-4a81-b341-91b98c5e0a14 (58c44db0-5257-4a81-b341-91b98c5e0a14): created successfully Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277dc4e3-1c16-4ad7-9bc8-c3d8e29579e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Flow 'volume_create_manager' (2daa0daa-5838-42a7-b986-4d3ea21b996c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e1aff-19fd-4c8a-bb5d-d3e0c3474f33]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cc81b1f2-03bb-4ede-bed8-cca414a52d5c tempest-VolumesListTestJSON-38971509 None] Created volume successfully. Sep 01 02:11:47 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 Sep 01 02:11:47 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:47 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14" returned: 0 in 0.453s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:47 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db 1G Sep 01 02:11:47 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:48 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db 1G" returned: 0 in 0.484s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:48 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db Sep 01 02:11:48 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:48 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:48 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:48 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db Sep 01 02:11:48 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Flow 'volume_create_manager' (2e0f74c1-b691-482e-804a-3f83afe7fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bf748d-4f11-4a38-bc10-9e9351255a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bf748d-4f11-4a38-bc10-9e9351255a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-601898580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29aca81-478d-4ed9-8bc9-aeeeecc07431,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144047ed94974837b28dd984e60a5142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:49Z,use_quota=True,user_id='09f3c49c82af436c90e3289d84bc2bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8095a7-9017-4406-bf82-aa9709432521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8095a7-9017-4406-bf82-aa9709432521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aff03ab-014e-4ee1-9e9a-03b68943949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aff03ab-014e-4ee1-9e9a-03b68943949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29aca81-478d-4ed9-8bc9-aeeeecc07431', 'volume_name': 'volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05063633-77e0-499f-a3a0-964c3e619c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05063633-77e0-499f-a3a0-964c3e619c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3ae31a-ffa6-4550-b640-dd19660d56f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Volume a29aca81-478d-4ed9-8bc9-aeeeecc07431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431', 'volume_size': 1} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:48 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db" returned: 0 in 0.263s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:48 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info Sep 01 02:11:48 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:49 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info" returned: 0 in 0.253s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:49 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:49 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info Sep 01 02:11:49 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:49 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.info" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.842s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Creating offline snapshot c9b7132c-96a0-4dd2-a375-05b908a4a4db of volume 89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bc83a0-0f09-496e-a58c-12a4904a3d0b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a41e0ced-2a15-40d1-b94c-a8c9b0fd02d7 tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 048cfa1c-e717-4970-bcbb-ece463917054: created successfully Sep 01 02:11:49 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 Sep 01 02:11:49 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 048cfa1c-e717-4970-bcbb-ece463917054: deleting Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 048cfa1c-e717-4970-bcbb-ece463917054: deleting {{(pid=87404) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-982e8acc-6b32-4053-a63b-a73c3cf46a14" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-982e8acc-6b32-4053-a63b-a73c3cf46a14" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-8adaf92d-244c-49a7-9139-4e7f853e80db" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:49 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-8adaf92d-244c-49a7-9139-4e7f853e80db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Deleting offline snapshot 8adaf92d-244c-49a7-9139-4e7f853e80db of volume 982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] snapshot_file for this snap is: volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76" returned: 0 in 0.444s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7b021-bfdb-49a9-ad66-1e8ba291b37f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:49 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db 1G Sep 01 02:11:49 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:50 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db Sep 01 02:11:50 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:50 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db" returned: 0 in 0.408s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982e8acc-6b32-4053-a63b-a73c3cf46a14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:50 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db 1G" returned: 0 in 0.457s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a93423-b8ef-4c73-9b40-4897d428bb76 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee499408-8170-48ef-803a-47a8622c1e90]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:50 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a93423-b8ef-4c73-9b40-4897d428bb76 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db Sep 01 02:11:50 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:50 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 Sep 01 02:11:50 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:50 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a93423-b8ef-4c73-9b40-4897d428bb76 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db" returned: 0 in 0.384s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:50 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db is being set with open permissions: ugo+rw Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:50 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db Sep 01 02:11:50 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:50 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14" returned: 0 in 0.463s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:50 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db Sep 01 02:11:50 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db" returned: 0 in 0.288s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:51 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info Sep 01 02:11:51 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db" returned: 0 in 0.393s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:51 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db Sep 01 02:11:51 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info" returned: 0 in 0.294s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info is being set with open permissions: ugo+rw Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:51 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info Sep 01 02:11:51 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14.8adaf92d-244c-49a7-9139-4e7f853e80db" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-8adaf92d-244c-49a7-9139-4e7f853e80db" released by "_delete_snapshot" :: held 1.746s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-982e8acc-6b32-4053-a63b-a73c3cf46a14" released by "delete_snapshot" :: held 1.774s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:51 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.info" returned: 0 in 0.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-601898580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29aca81-478d-4ed9-8bc9-aeeeecc07431,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144047ed94974837b28dd984e60a5142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:49Z,use_quota=True,user_id='09f3c49c82af436c90e3289d84bc2bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Creating volume a29aca81-478d-4ed9-8bc9-aeeeecc07431 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:51 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:51 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 1073741824 Sep 01 02:11:51 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1a9162d1-5457-45ce-ae6f-22044280bc9d tempest-CinderUnicodeTest-2097448618 None] Create snapshot completed successfully Sep 01 02:11:51 devstack cinder-volume[87404]: WARNING cinder.quota [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-162691228 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-162691228, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:51 devstack cinder-volume[87404]: WARNING cinder.quota [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-162691228 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-162691228, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:51 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['8beef8da-9114-4638-9f23-60b7997552df', '552d9b61-5f26-451f-9f25-cf13dc91b0d4', 'ca29fc3b-8561-4106-b99f-10c51645d14c', 'a66c22a7-771d-4954-87db-f058b8a26339'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e99c07ff-0ed3-4562-9d85-3d817a2c157e tempest-GroupSnapshotsTest-1351629572 None] group_snapshot 048cfa1c-e717-4970-bcbb-ece463917054: deleted successfully Sep 01 02:11:52 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 1073741824" returned: 0 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:52 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 Sep 01 02:11:52 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:52 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431" returned: 0 in 0.294s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3ae31a-ffa6-4550-b640-dd19660d56f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b4aaa7-fa7e-4113-82c4-d860b03ea604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:52 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Volume volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 (a29aca81-478d-4ed9-8bc9-aeeeecc07431): created successfully Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b4aaa7-fa7e-4113-82c4-d860b03ea604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Flow 'volume_create_manager' (2e0f74c1-b691-482e-804a-3f83afe7fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "cinder-quobyte-982e8acc-6b32-4053-a63b-a73c3cf46a14" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c79a2c7d-b067-4b80-9c87-d3a7ccc3da31 tempest-VolumesListTestJSON-38971509 None] Created volume successfully. Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-982e8acc-6b32-4053-a63b-a73c3cf46a14" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ca8b0-0761-4b56-867b-b040900e2f17]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:52 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 Sep 01 02:11:52 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-c9b7132c-96a0-4dd2-a375-05b908a4a4db-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-c9b7132c-96a0-4dd2-a375-05b908a4a4db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-quobyte-89a93423-b8ef-4c73-9b40-4897d428bb76" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-89a93423-b8ef-4c73-9b40-4897d428bb76" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-quobyte-c9b7132c-96a0-4dd2-a375-05b908a4a4db" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-c9b7132c-96a0-4dd2-a375-05b908a4a4db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Deleting offline snapshot c9b7132c-96a0-4dd2-a375-05b908a4a4db of volume 89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] snapshot_file for this snap is: volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[96780220-129e-45e1-91bf-9f4c260c7ad5]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:53 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:53 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14 Sep 01 02:11:53 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:53 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db Sep 01 02:11:53 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:53 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-982e8acc-6b32-4053-a63b-a73c3cf46a14" returned: 0 in 0.400s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Lock "cinder-quobyte-982e8acc-6b32-4053-a63b-a73c3cf46a14" released by "delete_volume" :: held 0.940s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:53 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db" returned: 0 in 0.535s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a93423-b8ef-4c73-9b40-4897d428bb76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[80edc5bf-9a87-4724-87ce-1b1f9c0237bb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['c4187cf5-8b32-4831-8a4d-8abb92df98d6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Flow 'volume_create_manager' (6696daf1-ab82-4ce6-aebe-831aa3854841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82705de4-4c4b-447e-b2a3-a6460a7ace5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 Sep 01 02:11:53 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82705de4-4c4b-447e-b2a3-a6460a7ace5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1718970869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fa5443-9d7c-4960-9d30-79552403b13c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144047ed94974837b28dd984e60a5142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:54Z,use_quota=True,user_id='09f3c49c82af436c90e3289d84bc2bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ebd665-b2ae-4744-9afb-119d042ad5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ebd665-b2ae-4744-9afb-119d042ad5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5b6947-6c5e-41a7-a4f5-ce788a7a24f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5b6947-6c5e-41a7-a4f5-ce788a7a24f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fa5443-9d7c-4960-9d30-79552403b13c', 'volume_name': 'volume-e3fa5443-9d7c-4960-9d30-79552403b13c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb83c15a-6b90-4ed1-aad7-e1fe673ec6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb83c15a-6b90-4ed1-aad7-e1fe673ec6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da555961-40bf-4e04-813b-da752af11a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Volume e3fa5443-9d7c-4960-9d30-79552403b13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fa5443-9d7c-4960-9d30-79552403b13c', 'volume_size': 1} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1718970869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fa5443-9d7c-4960-9d30-79552403b13c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144047ed94974837b28dd984e60a5142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:54Z,use_quota=True,user_id='09f3c49c82af436c90e3289d84bc2bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Creating volume e3fa5443-9d7c-4960-9d30-79552403b13c {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:53 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:53 devstack cinder-volume[87404]: WARNING cinder.quota [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-162691228 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-162691228, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:53 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c 1073741824 Sep 01 02:11:53 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Created reservations ['90da8735-e312-4eae-a6f3-974344dcd64d', '89cb8d34-4679-40e9-ae74-a569fb599299', '5511f768-10bf-4151-846b-151fd464807c', '8a2599ac-433a-4ca6-8989-a64c3cd1145e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:54 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:54 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db Sep 01 02:11:54 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:54 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.349s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-076d3d33-2ec4-46d2-998f-1e6109fa9a1a tempest-GroupSnapshotsTest-1351629572 None] Delete group completed successfully. Sep 01 02:11:54 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c 1073741824" returned: 0 in 0.609s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c Sep 01 02:11:54 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:54 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db" returned: 0 in 0.446s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db Sep 01 02:11:54 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:54 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c" returned: 0 in 0.303s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da555961-40bf-4e04-813b-da752af11a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fa5443-9d7c-4960-9d30-79552403b13c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:54 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b16e4a9-c406-43f0-b350-a8c0e17a2f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76.c9b7132c-96a0-4dd2-a375-05b908a4a4db" returned: 0 in 0.283s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Volume volume-e3fa5443-9d7c-4960-9d30-79552403b13c (e3fa5443-9d7c-4960-9d30-79552403b13c): created successfully Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b16e4a9-c406-43f0-b350-a8c0e17a2f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Flow 'volume_create_manager' (6696daf1-ab82-4ce6-aebe-831aa3854841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-c9b7132c-96a0-4dd2-a375-05b908a4a4db" released by "_delete_snapshot" :: held 1.927s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-89a93423-b8ef-4c73-9b40-4897d428bb76" released by "delete_snapshot" :: held 1.952s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dfbf4144-1bd7-40b3-a855-e43de86677b1 tempest-VolumesListTestJSON-38971509 None] Created volume successfully. Sep 01 02:11:54 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Created reservations ['b29c93b6-8b0d-4050-a916-6a47727e2b85', 'c51f66fa-d5a3-43af-906a-c0ea63803af2', '76047692-dfab-4197-b266-79a416501bdd', 'cf6609ce-ab6e-45c9-9044-35c332c85ff5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Delete snapshot completed successfully. Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4f9b0075-8388-4e16-9ed1-c56ca9d56300 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-c9b7132c-96a0-4dd2-a375-05b908a4a4db-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-89a93423-b8ef-4c73-9b40-4897d428bb76-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-89a93423-b8ef-4c73-9b40-4897d428bb76-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-quobyte-89a93423-b8ef-4c73-9b40-4897d428bb76" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-89a93423-b8ef-4c73-9b40-4897d428bb76" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4bb492-6861-4624-a82d-ed273aaccf8e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:55 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 Sep 01 02:11:55 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:55 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76" returned: 0 in 0.427s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:55 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76 Sep 01 02:11:55 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:56 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-89a93423-b8ef-4c73-9b40-4897d428bb76" returned: 0 in 0.388s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-89a93423-b8ef-4c73-9b40-4897d428bb76" released by "delete_volume" :: held 0.889s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=90,cinder:SELECT=106,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Created reservations ['97802d30-a3a7-4194-94e0-e3d3101f6cf7', '08178a0d-5822-4d2d-9cc5-06f14b7fbc63', '43fd5148-229d-48ca-b262-ddee12ac3605', 'cf5f5ef8-1e39-4279-8a8d-d61957d4ca56'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:56 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:56 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-c3107aec-2d51-43e0-968f-b06bbea7005f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-c3107aec-2d51-43e0-968f-b06bbea7005f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "cinder-quobyte-c3107aec-2d51-43e0-968f-b06bbea7005f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-c3107aec-2d51-43e0-968f-b06bbea7005f" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c5600-ba58-41c1-b09a-3a34994686f6]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:56 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f Sep 01 02:11:56 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:56 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.491s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Deleted volume successfully. Sep 01 02:11:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6a5c1837-8b7f-4c8d-b5bc-9c1e3d093cea tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-89a93423-b8ef-4c73-9b40-4897d428bb76-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:57 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f" returned: 0 in 0.530s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:57 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f Sep 01 02:11:57 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:57 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c3107aec-2d51-43e0-968f-b06bbea7005f" returned: 0 in 0.446s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-quobyte-c3107aec-2d51-43e0-968f-b06bbea7005f" released by "delete_volume" :: held 1.081s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Created reservations ['dc3ae2e4-a3d5-4119-91f8-9a1cdfa655d8', '5136e026-0ee0-4531-8f6a-8417012c7035', 'b6179e32-f20b-4a5e-a841-c310326ff7fd', '95f5ed45-757b-407b-ac0f-3263f9173eee'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:57 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:11:57 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:58 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.410s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:58 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Deleted volume successfully. Sep 01 02:11:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-66fbaacd-0cf3-4eea-bfc0-3966b3ea9a36 tempest-CinderUnicodeTest-2097448618 None] Lock "cinder-c3107aec-2d51-43e0-968f-b06bbea7005f-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "cinder-e3fa5443-9d7c-4960-9d30-79552403b13c-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-e3fa5443-9d7c-4960-9d30-79552403b13c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "cinder-quobyte-e3fa5443-9d7c-4960-9d30-79552403b13c" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-quobyte-e3fa5443-9d7c-4960-9d30-79552403b13c" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[462682b8-5f90-4fbe-bb0f-7c843eb61910]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:59 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c Sep 01 02:11:59 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:59 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c" returned: 0 in 0.475s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:00 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c Sep 01 02:12:00 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:00 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e3fa5443-9d7c-4960-9d30-79552403b13c" returned: 0 in 0.337s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-quobyte-e3fa5443-9d7c-4960-9d30-79552403b13c" released by "delete_volume" :: held 0.876s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Created reservations ['b7c059ee-4bab-494b-8f32-f01b2c92f2f4', 'd9f24656-1ac1-4307-8bb5-d6d62b6ec80e', 'add66bf5-163e-4b63-ad78-470545ce57ef', '73ee4e53-525d-4fe3-9306-835e861c4083'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:00 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:00 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:00 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:00 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Deleted volume successfully. Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c8321c53-3b8a-421a-be8e-fcd9f12bbec8 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-e3fa5443-9d7c-4960-9d30-79552403b13c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "cinder-a29aca81-478d-4ed9-8bc9-aeeeecc07431-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-a29aca81-478d-4ed9-8bc9-aeeeecc07431-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "cinder-quobyte-a29aca81-478d-4ed9-8bc9-aeeeecc07431" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-quobyte-a29aca81-478d-4ed9-8bc9-aeeeecc07431" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[635412c2-3e27-4a18-8146-1b5bd4daccd8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:01 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 Sep 01 02:12:01 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:02 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431" returned: 0 in 0.416s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431 Sep 01 02:12:02 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:02 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a29aca81-478d-4ed9-8bc9-aeeeecc07431" returned: 0 in 0.361s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-quobyte-a29aca81-478d-4ed9-8bc9-aeeeecc07431" released by "delete_volume" :: held 0.834s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Created reservations ['40c12656-c8e4-486d-a47d-ade005e57aca', '0a68e233-78de-45c1-bc91-8d1b3c4a8b5b', 'cf536acc-6c6f-4b9f-a7da-7a2ff1c2ff6a', '3d477b8e-f483-470f-87bf-5bd19a253473'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:02 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "cinder-58c44db0-5257-4a81-b341-91b98c5e0a14-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (1cf27a7d-d3bb-481a-b74c-f377a59d1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444717ea-8a8e-4d51-8b3d-978b1bfe5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-58c44db0-5257-4a81-b341-91b98c5e0a14-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444717ea-8a8e-4d51-8b3d-978b1bfe5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356962876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:03Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7426df98-8312-4cb7-b893-39a446a4892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7426df98-8312-4cb7-b893-39a446a4892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76b833e-1f4c-4151-a4dd-569bbf365497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76b833e-1f4c-4151-a4dd-569bbf365497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8', 'volume_name': 'volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd532b0-4110-48ae-b32d-0b0ffd1663c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd532b0-4110-48ae-b32d-0b0ffd1663c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f576ab6-ba1a-4d33-90f2-b9e34ebee023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Volume 12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8', 'volume_size': 1} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356962876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:03Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Creating volume 12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:03 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:03 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 1073741824 Sep 01 02:12:03 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "cinder-quobyte-58c44db0-5257-4a81-b341-91b98c5e0a14" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:03 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.512s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Deleted volume successfully. Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-quobyte-58c44db0-5257-4a81-b341-91b98c5e0a14" acquired by "delete_volume" :: waited 0.045s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058b312-d7cc-466c-a202-0c8a469821d3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-07b1a470-d214-4966-8f4d-89397c36cbd9 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-a29aca81-478d-4ed9-8bc9-aeeeecc07431-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:03 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 Sep 01 02:12:03 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (bb96e96f-f090-4b43-9607-4968670e03c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dea224b-0faf-462e-9657-7799232b7ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14" returned: 0 in 0.620s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14 Sep 01 02:12:04 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dea224b-0faf-462e-9657-7799232b7ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041174746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4f59c4-89b9-4903-93e7-aa63788814a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:04Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a28f92-c8a0-42ed-8dd8-7478c2faf908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a28f92-c8a0-42ed-8dd8-7478c2faf908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc391ec-adb8-49b1-936d-14872a2f89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc391ec-adb8-49b1-936d-14872a2f89b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4f59c4-89b9-4903-93e7-aa63788814a0', 'volume_name': 'volume-cf4f59c4-89b9-4903-93e7-aa63788814a0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20989054-650e-4665-9a94-57a116c413f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20989054-650e-4665-9a94-57a116c413f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51d7469-8c51-4e28-8dae-b4967f4c8b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Volume cf4f59c4-89b9-4903-93e7-aa63788814a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4f59c4-89b9-4903-93e7-aa63788814a0', 'volume_size': 1} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:04 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 1073741824" returned: 0 in 1.040s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 Sep 01 02:12:04 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:04 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (13991eb6-c923-4da6-881f-ce2cebf1da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c632358-1c38-4969-b997-da6c3b88027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-58c44db0-5257-4a81-b341-91b98c5e0a14" returned: 0 in 0.591s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-quobyte-58c44db0-5257-4a81-b341-91b98c5e0a14" released by "delete_volume" :: held 1.308s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c632358-1c38-4969-b997-da6c3b88027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366698891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f012895d-ddbd-42e1-8d37-50ed74496b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:04Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea023ba-8769-42a5-bc63-a055d6c8b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea023ba-8769-42a5-bc63-a055d6c8b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca0ad63-3221-4b7f-8d90-72dbccbbe1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca0ad63-3221-4b7f-8d90-72dbccbbe1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f012895d-ddbd-42e1-8d37-50ed74496b58', 'volume_name': 'volume-f012895d-ddbd-42e1-8d37-50ed74496b58', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48ffa92-b239-49a8-a79e-c11fed2b0b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48ffa92-b239-49a8-a79e-c11fed2b0b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a219498c-c018-4e63-9e53-c69594f62239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Volume f012895d-ddbd-42e1-8d37-50ed74496b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f012895d-ddbd-42e1-8d37-50ed74496b58', 'volume_size': 1} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:04 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8" returned: 0 in 0.421s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041174746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4f59c4-89b9-4903-93e7-aa63788814a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:04Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Creating volume cf4f59c4-89b9-4903-93e7-aa63788814a0 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:04 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 1073741824 Sep 01 02:12:04 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f576ab6-ba1a-4d33-90f2-b9e34ebee023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8594b550-8bb6-4560-88c2-eba3dd2dbde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Volume volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 (12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8): created successfully Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8594b550-8bb6-4560-88c2-eba3dd2dbde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (1cf27a7d-d3bb-481a-b74c-f377a59d1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-87cb6384-a48f-4c5c-93f2-d4fcae1db58e tempest-CreateVolumesFromImageTest-771179378 None] Created volume successfully. Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Created reservations ['ca965261-c61b-4ec6-9d6c-8bca54d05341', '1fdda177-357c-4831-af58-2af807923650', '31684a1d-dac2-4aa2-89ae-850257466752', '78103be1-f7c5-4d52-8f76-d6983a6e93b9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:05 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:05 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:05 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (34a43b41-d3a1-4308-8719-d41b4fa92fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22103bfc-c9be-4fe5-bd7b-8cadd24f1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 1073741824" returned: 0 in 0.834s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.533s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22103bfc-c9be-4fe5-bd7b-8cadd24f1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242574572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8f471f-a11e-4e57-a802-28103260ebf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:06Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcfd9d4-0a04-47a9-a6bc-0bcd4e68aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcfd9d4-0a04-47a9-a6bc-0bcd4e68aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13f3131-d196-4881-ad72-476d81600e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13f3131-d196-4881-ad72-476d81600e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8f471f-a11e-4e57-a802-28103260ebf8', 'volume_name': 'volume-9e8f471f-a11e-4e57-a802-28103260ebf8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d24213-edb0-4dbc-a299-6a784f9818a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d24213-edb0-4dbc-a299-6a784f9818a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d5620d-2e5b-409f-8c23-b120836ee69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:05 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Volume 9e8f471f-a11e-4e57-a802-28103260ebf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8f471f-a11e-4e57-a802-28103260ebf8', 'volume_size': 1} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Deleted volume successfully. Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa9a2848-25df-4539-922e-0f756bab4044 tempest-VolumesListTestJSON-38971509 None] Lock "cinder-58c44db0-5257-4a81-b341-91b98c5e0a14-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 Sep 01 02:12:06 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (5239f542-9622-4fa2-8a62-60d182e60e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:06 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2303e6-b320-4232-b37e-ab5376d9c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0" returned: 0 in 0.531s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366698891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f012895d-ddbd-42e1-8d37-50ed74496b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:04Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Creating volume f012895d-ddbd-42e1-8d37-50ed74496b58 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:06 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51d7469-8c51-4e28-8dae-b4967f4c8b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4f59c4-89b9-4903-93e7-aa63788814a0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807dcc87-46ac-4113-a9ba-2fbc3ab0c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 1073741824 Sep 01 02:12:06 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2303e6-b320-4232-b37e-ab5376d9c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-275133657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814e881d-a62c-49da-b95c-80bd4d1ae9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:06Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c135ee78-0692-4fa4-8c73-d5ec0658933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c135ee78-0692-4fa4-8c73-d5ec0658933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4626890f-d1d3-41b3-b6fe-b8ae8ab3fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4626890f-d1d3-41b3-b6fe-b8ae8ab3fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814e881d-a62c-49da-b95c-80bd4d1ae9ee', 'volume_name': 'volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7077c6-83c5-4d25-a144-6f3be3add0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7077c6-83c5-4d25-a144-6f3be3add0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa49ecd-a7ca-40bd-b34a-d0b1bfbe8aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:06 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Volume 814e881d-a62c-49da-b95c-80bd4d1ae9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee', 'volume_size': 1} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:06 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Volume volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 (cf4f59c4-89b9-4903-93e7-aa63788814a0): created successfully Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807dcc87-46ac-4113-a9ba-2fbc3ab0c619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (bb96e96f-f090-4b43-9607-4968670e03c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-79c6e0a3-2c0d-409a-944d-d1e736cb8756 tempest-CreateVolumesFromImageTest-771179378 None] Created volume successfully. Sep 01 02:12:07 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 1073741824" returned: 0 in 0.723s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:07 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 Sep 01 02:12:07 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:07 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58" returned: 0 in 0.368s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242574572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8f471f-a11e-4e57-a802-28103260ebf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:06Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Creating volume 9e8f471f-a11e-4e57-a802-28103260ebf8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:07 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:07 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 1073741824 Sep 01 02:12:07 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a219498c-c018-4e63-9e53-c69594f62239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f012895d-ddbd-42e1-8d37-50ed74496b58', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f50b671-a34a-4282-99ed-0b65a2862f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:07 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Volume volume-f012895d-ddbd-42e1-8d37-50ed74496b58 (f012895d-ddbd-42e1-8d37-50ed74496b58): created successfully Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f50b671-a34a-4282-99ed-0b65a2862f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (13991eb6-c923-4da6-881f-ce2cebf1da8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2d112271-c43a-4e62-a2c2-254773824b12 tempest-CreateVolumesFromImageTest-771179378 None] Created volume successfully. Sep 01 02:12:08 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 1073741824" returned: 0 in 0.710s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:08 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 Sep 01 02:12:08 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:08 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8" returned: 0 in 0.459s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-275133657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814e881d-a62c-49da-b95c-80bd4d1ae9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bf0d8a9fe847d0b0dac304f1935c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:06Z,use_quota=True,user_id='66875648b53b4eae90ce7eb2ea2531be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Creating volume 814e881d-a62c-49da-b95c-80bd4d1ae9ee {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:08 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d5620d-2e5b-409f-8c23-b120836ee69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8f471f-a11e-4e57-a802-28103260ebf8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8090e31e-b39f-4caa-a7cd-f80955736850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:08 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee 1073741824 Sep 01 02:12:08 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:08 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Volume volume-9e8f471f-a11e-4e57-a802-28103260ebf8 (9e8f471f-a11e-4e57-a802-28103260ebf8): created successfully Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8090e31e-b39f-4caa-a7cd-f80955736850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (34a43b41-d3a1-4308-8719-d41b4fa92fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d64957d0-8d79-4352-8997-3d9c6009c1c6 tempest-CreateVolumesFromImageTest-771179378 None] Created volume successfully. Sep 01 02:12:09 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee 1073741824" returned: 0 in 0.647s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:09 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee Sep 01 02:12:09 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:10 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee" returned: 0 in 0.443s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa49ecd-a7ca-40bd-b34a-d0b1bfbe8aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b7cdec-b668-44d5-aaf2-dfda791b4880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:10 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Volume volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee (814e881d-a62c-49da-b95c-80bd4d1ae9ee): created successfully Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b7cdec-b668-44d5-aaf2-dfda791b4880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Flow 'volume_create_manager' (5239f542-9622-4fa2-8a62-60d182e60e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:10 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-63b197a2-e2b7-4d66-b12e-d21ee2ef18ef tempest-CreateVolumesFromImageTest-771179378 None] Created volume successfully. Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-814e881d-a62c-49da-b95c-80bd4d1ae9ee-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-814e881d-a62c-49da-b95c-80bd4d1ae9ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-quobyte-814e881d-a62c-49da-b95c-80bd4d1ae9ee" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-814e881d-a62c-49da-b95c-80bd4d1ae9ee" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[30812ecb-39e9-4db4-8520-b47609423615]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee Sep 01 02:12:11 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:11 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee" returned: 0 in 0.524s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee Sep 01 02:12:11 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-814e881d-a62c-49da-b95c-80bd4d1ae9ee" returned: 0 in 0.341s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-814e881d-a62c-49da-b95c-80bd4d1ae9ee" released by "delete_volume" :: held 0.927s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Created reservations ['5aca5600-4e63-4903-b1a7-9c8178a0e274', 'ab9712d5-edab-444b-8582-7fab11071d69', 'e5b0ff66-35e3-485d-bb20-3697a186371f', '9d07510e-a7ab-436d-bfec-df0cba33fdda'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:12 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.339s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Deleted volume successfully. Sep 01 02:12:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0960ab35-e5df-43d4-81af-c48799a15ce5 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-814e881d-a62c-49da-b95c-80bd4d1ae9ee-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-9e8f471f-a11e-4e57-a802-28103260ebf8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-9e8f471f-a11e-4e57-a802-28103260ebf8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-quobyte-9e8f471f-a11e-4e57-a802-28103260ebf8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-9e8f471f-a11e-4e57-a802-28103260ebf8" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc2456c-f1b0-42ed-9e5b-e77ceb498701]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:13 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 Sep 01 02:12:13 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8" returned: 0 in 0.421s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8 Sep 01 02:12:14 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9e8f471f-a11e-4e57-a802-28103260ebf8" returned: 0 in 0.324s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-9e8f471f-a11e-4e57-a802-28103260ebf8" released by "delete_volume" :: held 0.803s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Created reservations ['6bd9669a-e0df-4e3e-b405-5a3683082a6e', '400103c6-013b-4b9f-bdb8-8eb6923f81da', '0f43d92b-d4f9-40a4-8e48-d6cf84f3dfe9', 'ac28f735-6dc0-4adf-add7-0c2532a79e14'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:14 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-f012895d-ddbd-42e1-8d37-50ed74496b58-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-f012895d-ddbd-42e1-8d37-50ed74496b58-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-quobyte-f012895d-ddbd-42e1-8d37-50ed74496b58" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-f012895d-ddbd-42e1-8d37-50ed74496b58" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0143ed7-67ef-4c6f-b433-01efb156fd0d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.350s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:14 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Deleted volume successfully. Sep 01 02:12:14 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 Sep 01 02:12:14 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5da2b7f6-94ee-4223-9643-6c138387c3cc tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-9e8f471f-a11e-4e57-a802-28103260ebf8-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:15 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58" returned: 0 in 0.405s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58 Sep 01 02:12:15 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f012895d-ddbd-42e1-8d37-50ed74496b58" returned: 0 in 0.297s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-f012895d-ddbd-42e1-8d37-50ed74496b58" released by "delete_volume" :: held 0.769s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Created reservations ['40a980f4-7fdf-4b25-8907-10fc1a390ffe', '1ff43bff-d3ab-46c0-a640-e7e79d87a856', 'cd27878a-93c8-43b6-a9e0-ff1aaed41dcf', 'ccff283a-a7ad-413a-8189-9ef9e790e6c5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:15 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-cf4f59c4-89b9-4903-93e7-aa63788814a0-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-cf4f59c4-89b9-4903-93e7-aa63788814a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:15 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.312s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:15 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Deleted volume successfully. Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-quobyte-cf4f59c4-89b9-4903-93e7-aa63788814a0" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7f53b3eb-f12a-4883-9475-c0c7ad967ef2 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-f012895d-ddbd-42e1-8d37-50ed74496b58-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-cf4f59c4-89b9-4903-93e7-aa63788814a0" acquired by "delete_volume" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ae41a-6112-4ba2-b291-cb8142380aff]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 Sep 01 02:12:16 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0" returned: 0 in 0.416s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0 Sep 01 02:12:16 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-cf4f59c4-89b9-4903-93e7-aa63788814a0" returned: 0 in 0.313s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-cf4f59c4-89b9-4903-93e7-aa63788814a0" released by "delete_volume" :: held 0.785s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Created reservations ['3b8522f8-18f6-4808-a1d2-ed5bf8075466', '661a07d7-a461-4217-819c-57d5e403fe55', '091f90a9-63c8-4242-b7dd-8ea2429cc9b8', 'c2522c3a-5d81-495b-802f-79e3f96f960c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:17 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "cinder-quobyte-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8" acquired by "delete_volume" :: waited 0.030s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[68299e60-e986-4d35-9394-a0fbce41f63e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.466s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Deleted volume successfully. Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-31bc4b1b-2509-4546-82dc-5e1c43b644a9 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-cf4f59c4-89b9-4903-93e7-aa63788814a0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:17 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 Sep 01 02:12:17 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:17 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8" returned: 0 in 0.431s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8 Sep 01 02:12:17 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8" returned: 0 in 0.297s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-quobyte-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8" released by "delete_volume" :: held 0.792s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Created reservations ['e8cf0d33-4c9a-4707-9fa5-5413aae626e9', '7e5dcb42-8035-4053-91b0-fd7c980e2498', '10daeb75-fe87-48a9-b9c5-f9d143df67bb', '4e872554-2544-4c6f-bc89-53138eec674c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:18 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:18 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.371s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Deleted volume successfully. Sep 01 02:12:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22f4824d-f70a-4d5d-9e26-ae05d9d3ee05 tempest-CreateVolumesFromImageTest-771179378 None] Lock "cinder-12902fbc-d2db-45eb-90ca-bc0fcaeeb9f8-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Flow 'volume_create_manager' (b0a12824-7f88-4b1f-b562-f981c6d5443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e338531b-542a-42a2-a9dc-255da1a520c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e338531b-542a-42a2-a9dc-255da1a520c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-553258220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c42343-3de6-45f6-bf0d-3873227bd93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2e35259bec4d1280fe693393bb9a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:24Z,use_quota=True,user_id='96ad90e8be6d4e569a2723b4797e6e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd0be95-3b5a-4d2f-b59f-ac733f6bbd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd0be95-3b5a-4d2f-b59f-ac733f6bbd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09304c0b-0669-443b-9c4a-6b8dc3c399e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09304c0b-0669-443b-9c4a-6b8dc3c399e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c42343-3de6-45f6-bf0d-3873227bd93b', 'volume_name': 'volume-c6c42343-3de6-45f6-bf0d-3873227bd93b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e013d1b7-b276-4f8e-ac08-32e54c7759ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e013d1b7-b276-4f8e-ac08-32e54c7759ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b90670a-d220-4211-bfa9-8bfb962392da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Volume c6c42343-3de6-45f6-bf0d-3873227bd93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c42343-3de6-45f6-bf0d-3873227bd93b', 'volume_size': 1} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-553258220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c42343-3de6-45f6-bf0d-3873227bd93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2e35259bec4d1280fe693393bb9a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:24Z,use_quota=True,user_id='96ad90e8be6d4e569a2723b4797e6e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Creating volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:23 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:23 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b 1073741824 Sep 01 02:12:23 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b 1073741824" returned: 0 in 0.539s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b Sep 01 02:12:24 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b" returned: 0 in 0.300s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b90670a-d220-4211-bfa9-8bfb962392da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c42343-3de6-45f6-bf0d-3873227bd93b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5926c75-7cc7-495f-af1c-4eb288ac8031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Volume volume-c6c42343-3de6-45f6-bf0d-3873227bd93b (c6c42343-3de6-45f6-bf0d-3873227bd93b): created successfully Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5926c75-7cc7-495f-af1c-4eb288ac8031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Flow 'volume_create_manager' (b0a12824-7f88-4b1f-b562-f981c6d5443c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0ce1bce0-0284-4502-8ed0-a2aa45060cf7 tempest-SnapshotsActionsTest-934563636 None] Created volume successfully. Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Creating offline snapshot 62abd79a-5199-41dc-b572-e38fb44e5d9d of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d542a6-238a-44b3-b424-39e369de4be3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b Sep 01 02:12:26 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b" returned: 0 in 0.476s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d 1G Sep 01 02:12:26 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d 1G" returned: 0 in 0.561s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:27 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:27 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.349s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d is being set with open permissions: ugo+rw Sep 01 02:12:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:27 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:27 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.410s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info Sep 01 02:12:28 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:28 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info" returned: 0 in 0.487s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:28 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info is being set with open permissions: ugo+rw Sep 01 02:12:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info Sep 01 02:12:28 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:29 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.435s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:12:29 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.info" returned: 0 in 0.380s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.830s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-252b7c7b-c504-40de-9a8a-63b1d948b708 tempest-SnapshotsActionsTest-934563636 None] Create snapshot completed successfully Sep 01 02:12:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Creating offline snapshot 4d16e23c-23bf-40a2-80a1-31b7d3d7b0db of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b54f73-4fd7-4176-a0c4-a22557321d98]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:30 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:30 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.545s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db 1G Sep 01 02:12:31 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Flow 'volume_create_manager' (cac1da28-29a1-407d-8725-b604eace9d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a6f9c-7608-44e2-b8c7-d7ea4590f531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a6f9c-7608-44e2-b8c7-d7ea4590f531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a392345-8b48-426a-b717-ba49b9effd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891b8291ab84375933033dc9095a841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:31Z,use_quota=True,user_id='2c3579cd755c4c29bd8ec45b45bf9ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb50903-887d-4fb8-bcdf-379007f45cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb50903-887d-4fb8-bcdf-379007f45cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8566c6b-a64a-48b0-9bc4-93684e75b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:12:31 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db 1G" returned: 0 in 0.722s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:32 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db Sep 01 02:12:32 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8566c6b-a64a-48b0-9bc4-93684e75b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a392345-8b48-426a-b717-ba49b9effd2a', 'volume_name': 'volume-9a392345-8b48-426a-b717-ba49b9effd2a', 'volume_size': 1, 'image_id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc5b8c8a688b21e4460e8cb7f7f483fd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f891b8291ab84375933033dc9095a841', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea89ca820d5560499a6cf543a579601e5deb8d681158442ac7b6c3240460827150a2e378d882c451bbafcc421440a18419fb1f4ebf120cbb81f6bffe78f4e866', 'id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e/file', 'properties': {}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802231cf-4605-4494-ab1c-ac3870d51259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802231cf-4605-4494-ab1c-ac3870d51259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f406410-823c-4aa8-a400-a1ced378774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:32 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Volume 9a392345-8b48-426a-b717-ba49b9effd2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a392345-8b48-426a-b717-ba49b9effd2a', 'volume_size': 1, 'image_id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc5b8c8a688b21e4460e8cb7f7f483fd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f891b8291ab84375933033dc9095a841', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea89ca820d5560499a6cf543a579601e5deb8d681158442ac7b6c3240460827150a2e378d882c451bbafcc421440a18419fb1f4ebf120cbb81f6bffe78f4e866', 'id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e/file', 'properties': {}}, 'image_service': } Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Trying to clone 9a392345-8b48-426a-b717-ba49b9effd2a from image 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e at location (None, [{'url': 'file:///opt/stack/data/glance/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:12:32 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:12:32 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" returned: 0 in 0.401s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db is being set with open permissions: ugo+rw Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec08b6-52f2-402a-bc8a-c7a51fec0460]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:32 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db Sep 01 02:12:32 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD Sep 01 02:12:32 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" returned: 0 in 0.342s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a7394397-2db7-470a-8140-12d783e34c84 tempest-SnapshotsActionsTest-934563636 None] Create snapshot completed successfully Sep 01 02:12:32 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:32 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD Sep 01 02:12:32 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Temporary image 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e is fetched for user 2c3579cd755c4c29bd8ec45b45bf9ef6. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eafa2ca-3581-47dc-9184-6883edbec3a3]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD Sep 01 02:12:33 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD Sep 01 02:12:33 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-4d16e23c-23bf-40a2-80a1-31b7d3d7b0db-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-4d16e23c-23bf-40a2-80a1-31b7d3d7b0db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Deleting offline snapshot 4d16e23c-23bf-40a2-80a1-31b7d3d7b0db of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] snapshot_file for this snap is: volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[60768051-e35d-4278-8375-1937af65ac4a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a392345-8b48-426a-b717-ba49b9effd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f891b8291ab84375933033dc9095a841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:31Z,use_quota=True,user_id='2c3579cd755c4c29bd8ec45b45bf9ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Creating volume 9a392345-8b48-426a-b717-ba49b9effd2a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:34 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a 1073741824 Sep 01 02:12:34 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db Sep 01 02:12:34 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" returned: 0 in 0.457s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a41f66-e603-4d6a-9652-0070cf9a48de]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:34 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a 1073741824" returned: 0 in 0.634s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a Sep 01 02:12:35 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.437s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db Sep 01 02:12:35 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a" returned: 0 in 0.494s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Attempting download of 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e ((None, [{'url': 'file:///opt/stack/data/glance/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'metadata': {}}])) to volume 9a392345-8b48-426a-b717-ba49b9effd2a. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8481f6b5-ba5c-4a5d-8486-eb72836410e1]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr Sep 01 02:12:35 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" returned: 0 in 0.664s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db Sep 01 02:12:35 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr" returned: 0 in 0.438s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr Sep 01 02:12:36 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-4d16e23c-23bf-40a2-80a1-31b7d3d7b0db" released by "_delete_snapshot" :: held 2.101s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" released by "delete_snapshot" :: held 2.149s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Created reservations ['5515056c-1c0d-4898-99d0-072591e47169', '16bd220e-b097-4827-889a-397f4921917d', '2e11961e-1b96-4b1d-9679-8c3d92ffb8ca', '469a88fa-53ad-458f-9e2f-9805f956a047'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Delete snapshot completed successfully. Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-dff70481-1854-468b-9a8b-d59593ce519f tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-4d16e23c-23bf-40a2-80a1-31b7d3d7b0db-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:36 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr" returned: 1 in 0.543s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_m2by3twr' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda27f7-769a-44eb-86a2-84ab2687934f]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD Sep 01 02:12:36 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD Sep 01 02:12:37 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e was raw, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a Sep 01 02:12:37 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Creating offline snapshot b457c1c8-fcd3-4929-8daf-3f464e33a16a of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb719c-c3f9-411d-b075-44229f9c9012]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:38 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a" returned: 0 in 0.720s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83d6d607-2a49-43f9-a9fb-0c02b7d76d5e_0kwr0u3zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:38 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a 1G Sep 01 02:12:38 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.430s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a 1G Sep 01 02:12:38 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a 1G" returned: 0 in 0.408s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Downloaded image 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e ((None, [{'url': 'file:///opt/stack/data/glance/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'metadata': {}}])) to volume 9a392345-8b48-426a-b717-ba49b9effd2a successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Temporary image 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e for user 2c3579cd755c4c29bd8ec45b45bf9ef6 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Marking volume 9a392345-8b48-426a-b717-ba49b9effd2a as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Copying metadata from image 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e to 9a392345-8b48-426a-b717-ba49b9effd2a. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Creating volume glance metadata for volume 9a392345-8b48-426a-b717-ba49b9effd2a backed by image 83d6d607-2a49-43f9-a9fb-0c02b7d76d5e with: {'image_id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dc5b8c8a688b21e4460e8cb7f7f483fd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f406410-823c-4aa8-a400-a1ced378774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a392345-8b48-426a-b717-ba49b9effd2a', 'volume_size': 1, 'image_id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc5b8c8a688b21e4460e8cb7f7f483fd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f891b8291ab84375933033dc9095a841', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea89ca820d5560499a6cf543a579601e5deb8d681158442ac7b6c3240460827150a2e378d882c451bbafcc421440a18419fb1f4ebf120cbb81f6bffe78f4e866', 'id': '83d6d607-2a49-43f9-a9fb-0c02b7d76d5e', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83d6d607-2a49-43f9-a9fb-0c02b7d76d5e/file', 'properties': {}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d5f4be-0b14-4186-8880-7749c9cf919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Volume volume-9a392345-8b48-426a-b717-ba49b9effd2a (9a392345-8b48-426a-b717-ba49b9effd2a): created successfully Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d5f4be-0b14-4186-8880-7749c9cf919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Flow 'volume_create_manager' (cac1da28-29a1-407d-8725-b604eace9d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ae93de39-7552-4c9e-95d2-f0ca4e334f8d tempest-VolumeImageDependencyTests-1152991940 None] Created volume successfully. Sep 01 02:12:38 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a 1G" returned: 0 in 0.606s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a Sep 01 02:12:39 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Acquiring lock "cinder-9a392345-8b48-426a-b717-ba49b9effd2a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Lock "cinder-9a392345-8b48-426a-b717-ba49b9effd2a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Acquiring lock "cinder-quobyte-9a392345-8b48-426a-b717-ba49b9effd2a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Lock "cinder-quobyte-9a392345-8b48-426a-b717-ba49b9effd2a" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f699b16-cc9c-4e9a-8f0a-ef698651b3dd]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a Sep 01 02:12:39 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a" returned: 0 in 0.540s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a is being set with open permissions: ugo+rw Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a Sep 01 02:12:39 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a" returned: 0 in 0.321s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=170,cinder:INSERT=44,cinder:SELECT=125,cinder:DELETE=18 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a" returned: 0 in 0.530s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a Sep 01 02:12:39 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4f95cdc3-8614-4dd8-a1ab-a5656e46e70f tempest-SnapshotsActionsTest-934563636 None] Create snapshot completed successfully Sep 01 02:12:40 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9a392345-8b48-426a-b717-ba49b9effd2a" returned: 0 in 0.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Lock "cinder-quobyte-9a392345-8b48-426a-b717-ba49b9effd2a" released by "delete_volume" :: held 0.931s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Created reservations ['0ea1d721-6ba9-4bf7-8e59-ce0a8ce9d54c', '2e0f0a4c-1d14-4764-97e1-686a8e8fd60e', 'c573bb52-a339-4afb-ba05-f41755250ecb', '44f66464-89d7-4acc-adc3-bf6c8856a185'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:12:40 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Deleted volume successfully. Sep 01 02:12:40 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d59f4508-2927-4f18-a1a1-5cce92c5a437 tempest-VolumeImageDependencyTests-1152991940 None] Lock "cinder-9a392345-8b48-426a-b717-ba49b9effd2a-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-b457c1c8-fcd3-4929-8daf-3f464e33a16a-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-b457c1c8-fcd3-4929-8daf-3f464e33a16a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-b457c1c8-fcd3-4929-8daf-3f464e33a16a" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-b457c1c8-fcd3-4929-8daf-3f464e33a16a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Deleting offline snapshot b457c1c8-fcd3-4929-8daf-3f464e33a16a of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] snapshot_file for this snap is: volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e91cda-f4bf-4258-acdd-e64b07794711]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a Sep 01 02:12:41 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a" returned: 0 in 0.642s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ee77db-e0ec-402c-bca0-d301a4ce14d1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:42 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:42 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:42 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.572s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:42 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a Sep 01 02:12:42 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:43 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a" returned: 0 in 0.587s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:43 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a Sep 01 02:12:43 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:43 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.b457c1c8-fcd3-4929-8daf-3f464e33a16a" returned: 0 in 0.524s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-b457c1c8-fcd3-4929-8daf-3f464e33a16a" released by "_delete_snapshot" :: held 2.481s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" released by "delete_snapshot" :: held 2.522s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Created reservations ['efc20483-9ba9-436a-8760-d28cb12d5793', 'e9b49d5d-28a1-483f-84e5-ed413ac60f6f', '9d67a2f7-0df3-4ab6-9c62-cc5d2311b0bd', 'ca33e440-d938-4ef8-b1ca-163e46c9e5c6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Delete snapshot completed successfully. Sep 01 02:12:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-655e6dc2-1237-4006-ae42-26e24149e0fc tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-b457c1c8-fcd3-4929-8daf-3f464e33a16a-delete_snapshot" released by "delete_snapshot" :: held 2.791s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Creating offline snapshot f48a94cf-2e79-48e0-9865-35fd15c014b3 of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:44 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1be7749-8804-41f7-aac0-1a23957496ae]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:45 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.424s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 1G Sep 01 02:12:45 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 1G" returned: 0 in 0.580s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 Sep 01 02:12:45 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:46 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3" returned: 0 in 0.422s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:46 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 is being set with open permissions: ugo+rw Sep 01 02:12:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:46 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 Sep 01 02:12:46 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:46 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3" returned: 0 in 0.325s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-edd9377e-b581-494e-a449-e1ab1b13148f tempest-SnapshotsActionsTest-934563636 None] Create snapshot completed successfully Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Flow 'volume_create_manager' (7bc6c598-b24c-4104-9fd9-e6ad1744d291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d27807-c396-4702-8bce-d36f73d148d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d27807-c396-4702-8bce-d36f73d148d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-662063740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac80459-4930-498d-8d6a-95fea92a4f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641084cd21224816915daca8f598aab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:47Z,use_quota=True,user_id='55d1c584f4d14a7589af63db454e6195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30635520-c7b4-4bcf-8238-cd8c19b0c2bb),volume_type_id=30635520-c7b4-4bcf-8238-cd8c19b0c2bb)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff470979-6250-4116-ada4-a22ea230d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff470979-6250-4116-ada4-a22ea230d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab60117-18dd-4524-aeba-a41080a32c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab60117-18dd-4524-aeba-a41080a32c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bac80459-4930-498d-8d6a-95fea92a4f10', 'volume_name': 'volume-bac80459-4930-498d-8d6a-95fea92a4f10', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bc0f7e-ae45-4fdd-bbda-86c5aae4ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bc0f7e-ae45-4fdd-bbda-86c5aae4ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977cd37d-c53a-44d3-a1b3-c5a30588a5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume bac80459-4930-498d-8d6a-95fea92a4f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bac80459-4930-498d-8d6a-95fea92a4f10', 'volume_size': 1} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-662063740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac80459-4930-498d-8d6a-95fea92a4f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641084cd21224816915daca8f598aab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:47Z,use_quota=True,user_id='55d1c584f4d14a7589af63db454e6195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30635520-c7b4-4bcf-8238-cd8c19b0c2bb),volume_type_id=30635520-c7b4-4bcf-8238-cd8c19b0c2bb)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Creating volume bac80459-4930-498d-8d6a-95fea92a4f10 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:47 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:47 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 1073741824 Sep 01 02:12:47 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Flow 'volume_create_manager' (8024a4f9-469e-4ecd-a896-3fdf3215a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc7804d-38f6-40c8-bc33-3585b8f032b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-f48a94cf-2e79-48e0-9865-35fd15c014b3-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc7804d-38f6-40c8-bc33-3585b8f032b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2037103137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7d0557-aa73-4664-a726-23a5b457f56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcc9926cb49442eb96fa740b92ea648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:47Z,use_quota=True,user_id='7f354517feb84b1e934332f9dc7493f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848780b1-9e35-4088-a192-26e7f0d8670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848780b1-9e35-4088-a192-26e7f0d8670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e305ad9b-791c-485f-a712-4031c8c4be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e305ad9b-791c-485f-a712-4031c8c4be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7d0557-aa73-4664-a726-23a5b457f56b', 'volume_name': 'volume-4e7d0557-aa73-4664-a726-23a5b457f56b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdd48a9-542e-4cd7-bc29-47312d82d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdd48a9-542e-4cd7-bc29-47312d82d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be75925-26b0-43fe-9de4-a7de977ad5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Volume 4e7d0557-aa73-4664-a726-23a5b457f56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7d0557-aa73-4664-a726-23a5b457f56b', 'volume_size': 1} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-f48a94cf-2e79-48e0-9865-35fd15c014b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-f48a94cf-2e79-48e0-9865-35fd15c014b3" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-f48a94cf-2e79-48e0-9865-35fd15c014b3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Deleting offline snapshot f48a94cf-2e79-48e0-9865-35fd15c014b3 of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] snapshot_file for this snap is: volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11dd92a-9ddb-4cdd-998f-f1de7480e800]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Flow 'volume_create_manager' (d8c68396-fffa-403b-ac21-62c6847a2e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebfb335-c8d2-46be-a345-bfb10f8d60f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebfb335-c8d2-46be-a345-bfb10f8d60f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582963776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d00ae53-2436-4394-bcd7-d460c84c4bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641084cd21224816915daca8f598aab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:48Z,use_quota=True,user_id='55d1c584f4d14a7589af63db454e6195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dccd621d-fd71-4102-b05e-0c0001a29cf6),volume_type_id=dccd621d-fd71-4102-b05e-0c0001a29cf6)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa655e9-37a8-43d3-9b28-b3ca31583f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa655e9-37a8-43d3-9b28-b3ca31583f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6574eb7f-abeb-4f7d-a375-adcc77e7bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6574eb7f-abeb-4f7d-a375-adcc77e7bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d00ae53-2436-4394-bcd7-d460c84c4bef', 'volume_name': 'volume-4d00ae53-2436-4394-bcd7-d460c84c4bef', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1d562a-7e97-41fd-8b65-e218ba6dd600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1d562a-7e97-41fd-8b65-e218ba6dd600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7093d2eb-f379-4759-8a50-bb8ed29f9204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume 4d00ae53-2436-4394-bcd7-d460c84c4bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d00ae53-2436-4394-bcd7-d460c84c4bef', 'volume_size': 1} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:47 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 Sep 01 02:12:47 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:47 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 1073741824" returned: 0 in 0.571s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:47 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 Sep 01 02:12:47 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3" returned: 0 in 0.445s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ae025-fcf3-4b5c-9c06-91b5c00887bc]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2037103137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7d0557-aa73-4664-a726-23a5b457f56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcc9926cb49442eb96fa740b92ea648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:47Z,use_quota=True,user_id='7f354517feb84b1e934332f9dc7493f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Creating volume 4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:48 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977cd37d-c53a-44d3-a1b3-c5a30588a5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac80459-4930-498d-8d6a-95fea92a4f10', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b3b97c-0ff2-4198-82e2-f0a925566c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume volume-bac80459-4930-498d-8d6a-95fea92a4f10 (bac80459-4930-498d-8d6a-95fea92a4f10): created successfully Sep 01 02:12:48 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b 1073741824 Sep 01 02:12:48 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b3b97c-0ff2-4198-82e2-f0a925566c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Flow 'volume_create_manager' (7bc6c598-b24c-4104-9fd9-e6ad1744d291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-74482705-5dd6-4bdd-b5a7-3676ebccc21e tempest-TestInstancesWithCinderVolumes-1024417517 None] Created volume successfully. Sep 01 02:12:48 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:48 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Flow 'volume_create_manager' (0ddb27dc-a21b-4699-8033-4dc8a6f5be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053e03a3-3ba5-4e47-90e8-d52c51b00e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053e03a3-3ba5-4e47-90e8-d52c51b00e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-900709929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3acb1b3d-8b88-4228-bc6c-73f33b3cf61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641084cd21224816915daca8f598aab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:48Z,use_quota=True,user_id='55d1c584f4d14a7589af63db454e6195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(892de812-556c-440b-9f1d-7f10a5c4a10f),volume_type_id=892de812-556c-440b-9f1d-7f10a5c4a10f)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01eeeb1-d3a1-4a11-ae07-fa25f56360e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01eeeb1-d3a1-4a11-ae07-fa25f56360e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2a0dbb-dd14-472f-b3f1-9b2c0fafc1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:12:48 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.437s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 Sep 01 02:12:48 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b 1073741824" returned: 0 in 0.562s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b Sep 01 02:12:48 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2a0dbb-dd14-472f-b3f1-9b2c0fafc1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3acb1b3d-8b88-4228-bc6c-73f33b3cf61e', 'volume_name': 'volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e', 'volume_size': 1, 'image_id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4480aaa9-25ab-4c98-954e-acea6a4e2636', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--266467656', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '641084cd21224816915daca8f598aab1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4480aaa9-25ab-4c98-954e-acea6a4e2636/file', 'properties': {}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261e57ba-8a0f-415f-a06e-0acb9418dcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261e57ba-8a0f-415f-a06e-0acb9418dcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7816439-632f-497f-877d-6f1e567c978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e', 'volume_size': 1, 'image_id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4480aaa9-25ab-4c98-954e-acea6a4e2636', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--266467656', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '641084cd21224816915daca8f598aab1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4480aaa9-25ab-4c98-954e-acea6a4e2636/file', 'properties': {}}, 'image_service': } Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Trying to clone 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e from image 4480aaa9-25ab-4c98-954e-acea6a4e2636 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4480aaa9-25ab-4c98-954e-acea6a4e2636', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:12:48 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3" returned: 0 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:48 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3 Sep 01 02:12:48 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582963776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d00ae53-2436-4394-bcd7-d460c84c4bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641084cd21224816915daca8f598aab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:48Z,use_quota=True,user_id='55d1c584f4d14a7589af63db454e6195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dccd621d-fd71-4102-b05e-0c0001a29cf6),volume_type_id=dccd621d-fd71-4102-b05e-0c0001a29cf6)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Creating volume 4d00ae53-2436-4394-bcd7-d460c84c4bef {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:49 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be75925-26b0-43fe-9de4-a7de977ad5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7d0557-aa73-4664-a726-23a5b457f56b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:49 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef 1073741824 Sep 01 02:12:49 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3007ba-8de1-48e2-8308-1a02be4e843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Volume volume-4e7d0557-aa73-4664-a726-23a5b457f56b (4e7d0557-aa73-4664-a726-23a5b457f56b): created successfully Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3007ba-8de1-48e2-8308-1a02be4e843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Flow 'volume_create_manager' (8024a4f9-469e-4ecd-a896-3fdf3215a107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1a8637e7-bf42-4f99-9e22-8cce4fc129f6 tempest-SnapshotDependencyTests-1512620248 None] Created volume successfully. Sep 01 02:12:49 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.f48a94cf-2e79-48e0-9865-35fd15c014b3" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-f48a94cf-2e79-48e0-9865-35fd15c014b3" released by "_delete_snapshot" :: held 1.742s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" released by "delete_snapshot" :: held 1.775s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Created reservations ['b604730a-b057-406a-8701-e757f25b7632', 'b3f3ff69-458e-4510-8a83-1ce5f9416b3e', 'a663eef6-117c-4d59-94e7-ad194f33e665', 'de35f69b-b5b7-42c1-9b35-96b64c78cc82'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Delete snapshot completed successfully. Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-521fb305-b703-4f49-bcc2-a697e3117bb1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-f48a94cf-2e79-48e0-9865-35fd15c014b3-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:49 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef 1073741824" returned: 0 in 0.628s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:49 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef Sep 01 02:12:49 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:50 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef" returned: 0 in 0.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.276s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7093d2eb-f379-4759-8a50-bb8ed29f9204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d00ae53-2436-4394-bcd7-d460c84c4bef', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca762aee-b5bf-4c47-a69d-15d3f1cb0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Creating offline snapshot a77c4550-f73f-4e59-ae7e-738e6c4fee1b of volume 4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume volume-4d00ae53-2436-4394-bcd7-d460c84c4bef (4d00ae53-2436-4394-bcd7-d460c84c4bef): created successfully Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca762aee-b5bf-4c47-a69d-15d3f1cb0995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Flow 'volume_create_manager' (d8c68396-fffa-403b-ac21-62c6847a2e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f271d-ec66-4111-b88d-7cc4d05f7a1d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cefc3022-5eaf-44ea-a2e2-e7c8aa0cf0b6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Created volume successfully. Sep 01 02:12:50 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b Sep 01 02:12:50 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:50 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b" returned: 0 in 0.412s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b 1G Sep 01 02:12:50 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:50 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b 1G" returned: 0 in 0.462s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e7d0557-aa73-4664-a726-23a5b457f56b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e7d0557-aa73-4664-a726-23a5b457f56b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b Sep 01 02:12:51 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e7d0557-aa73-4664-a726-23a5b457f56b -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b" returned: 0 in 0.300s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b is being set with open permissions: ugo+rw Sep 01 02:12:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b Sep 01 02:12:51 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info Sep 01 02:12:51 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info is being set with open permissions: ugo+rw Sep 01 02:12:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info Sep 01 02:12:51 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:52 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.info" returned: 0 in 0.258s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.169s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Creating offline snapshot 8f8356f8-4c51-40f2-be2a-636e5737276e of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f997da17-6d39-429c-9aaa-745b471c7313 tempest-SnapshotDependencyTests-1512620248 None] Create snapshot completed successfully Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb14568-5185-4335-8458-a86df22b84c4]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:52 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:52 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.368s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e 1G Sep 01 02:12:52 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD, size 20.69 MB, duration 4.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:12:52 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Image download 20.69 MB at 5.17 MB/s Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ac0bd5-9c73-4349-8b1e-7f14583b49c5]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD Sep 01 02:12:52 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e 1G" returned: 0 in 0.538s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e Sep 01 02:12:53 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Temporary image 4480aaa9-25ab-4c98-954e-acea6a4e2636 is fetched for user 55d1c584f4d14a7589af63db454e6195. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c11c4-c113-460b-b53b-46034e1c4803]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD Sep 01 02:12:53 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e" returned: 0 in 0.443s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e is being set with open permissions: ugo+rw Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e Sep 01 02:12:53 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Flow 'volume_create_manager' (acf5e3a3-6f96-40c8-be56-2c482bbeaac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe41c3a4-0ccc-45db-9f91-9e33193ac064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe41c3a4-0ccc-45db-9f91-9e33193ac064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcc9926cb49442eb96fa740b92ea648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a77c4550-f73f-4e59-ae7e-738e6c4fee1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:54Z,use_quota=True,user_id='7f354517feb84b1e934332f9dc7493f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae32d18-9f01-4662-ac5c-f8f26787d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae32d18-9f01-4662-ac5c-f8f26787d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976f157b-8c14-441d-8727-39293a6bf574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:53 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976f157b-8c14-441d-8727-39293a6bf574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2', 'volume_name': 'volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2', 'volume_size': 1, 'snapshot_id': 'a77c4550-f73f-4e59-ae7e-738e6c4fee1b'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9354944b-393e-4edb-8b32-c0b1d9477c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9354944b-393e-4edb-8b32-c0b1d9477c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237f920d-9fb3-4d63-8b79-9f25b9bc4698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:53 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Volume f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2', 'volume_size': 1, 'snapshot_id': 'a77c4550-f73f-4e59-ae7e-738e6c4fee1b'} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:53 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e" returned: 0 in 0.279s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.760s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-900709929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3acb1b3d-8b88-4228-bc6c-73f33b3cf61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641084cd21224816915daca8f598aab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:48Z,use_quota=True,user_id='55d1c584f4d14a7589af63db454e6195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(892de812-556c-440b-9f1d-7f10a5c4a10f),volume_type_id=892de812-556c-440b-9f1d-7f10a5c4a10f)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Creating volume 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:53 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:12:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e 1073741824 Sep 01 02:12:53 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9ab23333-b924-48c9-bf07-324df13fda4b tempest-SnapshotsActionsTest-934563636 None] Create snapshot completed successfully Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-8f8356f8-4c51-40f2-be2a-636e5737276e-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-8f8356f8-4c51-40f2-be2a-636e5737276e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Acquiring lock "cinder-quobyte-8f8356f8-4c51-40f2-be2a-636e5737276e" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-8f8356f8-4c51-40f2-be2a-636e5737276e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Deleting offline snapshot 8f8356f8-4c51-40f2-be2a-636e5737276e of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] snapshot_file for this snap is: volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d307e79-8cf3-4c8f-b774-31c17aa8f9aa]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e 1073741824" returned: 0 in 0.501s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e Sep 01 02:12:54 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e Sep 01 02:12:54 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" returned: 0 in 0.306s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-quobyte-a77c4550-f73f-4e59-ae7e-738e6c4fee1b-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-a77c4550-f73f-4e59-ae7e-738e6c4fee1b-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Creating volume f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 from snapshot a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-quobyte-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Attempting download of 4480aaa9-25ab-4c98-954e-acea6a4e2636 ((None, [{'url': 'file:///opt/stack/data/glance/images/4480aaa9-25ab-4c98-954e-acea6a4e2636', 'metadata': {}}])) to volume 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:12:54 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] snapshot: a77c4550-f73f-4e59-ae7e-738e6c4fee1b, volume: f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5329873-d051-480b-8470-82dba940ea94]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33964f3-0699-440c-8d98-11d8799e793a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6affcdcf-d237-401b-843c-4a24526b4a51]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:55 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i Sep 01 02:12:55 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b Sep 01 02:12:55 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i" returned: 0 in 0.344s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.410s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e Sep 01 02:12:55 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b" returned: 0 in 0.448s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e7d0557-aa73-4664-a726-23a5b457f56b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcafe0fd-f435-4397-a525-fc3cb07217ea]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i Sep 01 02:12:55 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b Sep 01 02:12:55 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i" returned: 1 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4480aaa9-25ab-4c98-954e-acea6a4e2636_r8d8w63i' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967dcd4-d0c8-42b9-8d16-d71ba99cb2b1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e" returned: 0 in 0.481s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:12:55 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:12:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 Sep 01 02:12:55 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD Sep 01 02:12:55 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:56 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.8f8356f8-4c51-40f2-be2a-636e5737276e" returned: 0 in 0.258s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-8f8356f8-4c51-40f2-be2a-636e5737276e" released by "_delete_snapshot" :: held 1.737s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" released by "delete_snapshot" :: held 1.773s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=141,cinder:SELECT=110,cinder:INSERT=38,cinder:DELETE=8 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:56 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] 4480aaa9-25ab-4c98-954e-acea6a4e2636 was qcow2, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Created reservations ['803deb58-4348-43be-8bc5-dbbdadd58c3d', 'b9e85aa4-c60b-46c9-a19a-3ddc8e0b143f', 'e760a61a-c50b-4daa-94ec-1b03d05d5c73', '97009055-ad16-40ec-a0d0-93ccbe244fa0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:56 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e Sep 01 02:12:56 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Delete snapshot completed successfully. Sep 01 02:12:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a3435b6b-b408-4c0d-9eae-4e1179fad8b1 tempest-SnapshotsActionsTest-839690216 None] Lock "cinder-8f8356f8-4c51-40f2-be2a-636e5737276e-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "cinder-62abd79a-5199-41dc-b572-e38fb44e5d9d-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-62abd79a-5199-41dc-b572-e38fb44e5d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "cinder-quobyte-62abd79a-5199-41dc-b572-e38fb44e5d9d" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-quobyte-62abd79a-5199-41dc-b572-e38fb44e5d9d" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Deleting offline snapshot 62abd79a-5199-41dc-b572-e38fb44e5d9d of volume c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] snapshot_file for this snap is: volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32acd50-8b9c-446e-bf1a-96182d371224]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:58 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:12:58 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 1.173s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c42343-3de6-45f6-bf0d-3873227bd93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94cc075-45d7-4d9f-a764-42cf8de7ef5f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:59 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b Sep 01 02:12:59 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" returned: 0 in 4.445s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4480aaa9-25ab-4c98-954e-acea6a4e2636_df9v63x1devstack@QuobyteHD, size 112.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:00 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Converted 112.00 MB image at 25.19 MB/s Sep 01 02:13:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e 1G Sep 01 02:13:00 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b" returned: 0 in 1.202s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:13:00 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e 1G" returned: 0 in 0.721s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Downloaded image 4480aaa9-25ab-4c98-954e-acea6a4e2636 ((None, [{'url': 'file:///opt/stack/data/glance/images/4480aaa9-25ab-4c98-954e-acea6a4e2636', 'metadata': {}}])) to volume 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Temporary image 4480aaa9-25ab-4c98-954e-acea6a4e2636 for user 55d1c584f4d14a7589af63db454e6195 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Marking volume 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:13:01 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" returned: 0 in 5.562s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:01 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Converted 1024.00 MB image at 184.07 MB/s Sep 01 02:13:01 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 is being set with open permissions: ugo+rw Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Copying metadata from image 4480aaa9-25ab-4c98-954e-acea6a4e2636 to 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Creating volume glance metadata for volume 3acb1b3d-8b88-4228-bc6c-73f33b3cf61e backed by image 4480aaa9-25ab-4c98-954e-acea6a4e2636 with: {'image_id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'image_name': 'tempest-scenario-img--266467656', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:13:01 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 Sep 01 02:13:01 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.697s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d Sep 01 02:13:01 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7816439-632f-497f-877d-6f1e567c978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e', 'volume_size': 1, 'image_id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4480aaa9-25ab-4c98-954e-acea6a4e2636', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--266467656', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '641084cd21224816915daca8f598aab1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4480aaa9-25ab-4c98-954e-acea6a4e2636', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4480aaa9-25ab-4c98-954e-acea6a4e2636/file', 'properties': {}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdd1118-3756-46af-9d36-dd7eaac96c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Volume volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e (3acb1b3d-8b88-4228-bc6c-73f33b3cf61e): created successfully Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdd1118-3756-46af-9d36-dd7eaac96c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Flow 'volume_create_manager' (0ddb27dc-a21b-4699-8033-4dc8a6f5be60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f3e131ad-7610-4b3a-878a-78a74b368ec6 tempest-TestInstancesWithCinderVolumes-1024417517 None] Created volume successfully. Sep 01 02:13:01 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" released by "_copy_volume_from_snapshot" :: held 6.876s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-a77c4550-f73f-4e59-ae7e-738e6c4fee1b-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" released by "_create_volume_from_snapshot" :: held 6.958s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.984s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:01 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b.62abd79a-5199-41dc-b572-e38fb44e5d9d" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237f920d-9fb3-4d63-8b79-9f25b9bc4698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2', 'volume_size': 1, 'snapshot_id': 'a77c4550-f73f-4e59-ae7e-738e6c4fee1b'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debf0844-b38d-418d-833f-2c6b18a41717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Volume volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 (f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2): created successfully Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debf0844-b38d-418d-833f-2c6b18a41717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Flow 'volume_create_manager' (acf5e3a3-6f96-40c8-be56-2c482bbeaac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-quobyte-62abd79a-5199-41dc-b572-e38fb44e5d9d" released by "_delete_snapshot" :: held 3.667s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" released by "delete_snapshot" :: held 3.737s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-71c582af-b793-492c-9ddf-dcdf6c6f3e38 tempest-SnapshotDependencyTests-1512620248 None] Created volume successfully. Sep 01 02:13:01 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Created reservations ['78a7dfb0-4a7e-4e2b-a050-c4ea421b1b81', '8a7a6894-4516-47a1-b5cb-b8b516d4d7d8', 'ee30ffcf-012d-46d5-8075-9f711b8500d4', '41eca46b-109b-4416-9bd4-f8356112130c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Delete snapshot completed successfully. Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-702095a9-cdf6-445b-90ff-574c14cad031 tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-62abd79a-5199-41dc-b572-e38fb44e5d9d-delete_snapshot" released by "delete_snapshot" :: held 3.948s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "cinder-c6c42343-3de6-45f6-bf0d-3873227bd93b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-c6c42343-3de6-45f6-bf0d-3873227bd93b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ad76a-4f29-4c5b-8771-228f058527a7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-a77c4550-f73f-4e59-ae7e-738e6c4fee1b-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-a77c4550-f73f-4e59-ae7e-738e6c4fee1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-quobyte-4e7d0557-aa73-4664-a726-23a5b457f56b" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-4e7d0557-aa73-4664-a726-23a5b457f56b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-quobyte-a77c4550-f73f-4e59-ae7e-738e6c4fee1b" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-a77c4550-f73f-4e59-ae7e-738e6c4fee1b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Deleting offline snapshot a77c4550-f73f-4e59-ae7e-738e6c4fee1b of volume 4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] snapshot_file for this snap is: volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:02 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b Sep 01 02:13:02 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4fa576-0436-4e78-90b7-6034284a71a7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b Sep 01 02:13:03 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b" returned: 0 in 0.446s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b Sep 01 02:13:03 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b" returned: 0 in 0.433s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e7d0557-aa73-4664-a726-23a5b457f56b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba41060a-1e17-4414-be79-d0baecbc485b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b Sep 01 02:13:03 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6c42343-3de6-45f6-bf0d-3873227bd93b" returned: 0 in 0.317s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-quobyte-c6c42343-3de6-45f6-bf0d-3873227bd93b" released by "delete_volume" :: held 0.836s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Created reservations ['6a5ceabc-00e0-46a7-83c8-b3fb252c4866', '00a62942-02e0-4d83-9751-ef9b70e61af9', 'f5d3149d-a20a-4663-aea5-ca03b3393a32', '0f5a4a4b-ee5a-447f-9d38-9511ea66409d'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:03 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b" returned: 0 in 0.704s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.365s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:04 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b Sep 01 02:13:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Deleted volume successfully. Sep 01 02:13:04 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-131d7ec1-8fce-4ea9-8d5e-7bf19c884b2c tempest-SnapshotsActionsTest-934563636 None] Lock "cinder-c6c42343-3de6-45f6-bf0d-3873227bd93b-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:04 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b" returned: 0 in 0.490s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b Sep 01 02:13:04 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b.a77c4550-f73f-4e59-ae7e-738e6c4fee1b" returned: 0 in 0.318s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-a77c4550-f73f-4e59-ae7e-738e6c4fee1b" released by "_delete_snapshot" :: held 2.099s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-4e7d0557-aa73-4664-a726-23a5b457f56b" released by "delete_snapshot" :: held 2.131s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:05 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Created reservations ['d4208f7c-79de-4de3-a852-de9930288444', '3f16f229-075b-47e6-b086-e1150d921c71', '47b182a7-5839-4799-b7f3-0a6a00dc6978', '5f80a14b-c589-4067-bdb7-19ffe81e17b1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Delete snapshot completed successfully. Sep 01 02:13:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fa321089-e324-4d62-89af-21cb38656d15 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-a77c4550-f73f-4e59-ae7e-738e6c4fee1b-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-0e5d10ec-7582-4ab8-8ffa-7a9d158e1834 req-804ba251-666b-4e9d-abc5-958872670ac2 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-0e5d10ec-7582-4ab8-8ffa-7a9d158e1834 req-804ba251-666b-4e9d-abc5-958872670ac2 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-0e5d10ec-7582-4ab8-8ffa-7a9d158e1834 req-804ba251-666b-4e9d-abc5-958872670ac2 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-0e5d10ec-7582-4ab8-8ffa-7a9d158e1834 req-804ba251-666b-4e9d-abc5-958872670ac2 tempest-TestInstancesWithCinderVolumes-1024417517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bedbb12-ee22-4ce3-aae5-c361eb3d18e9', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:13:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-0e5d10ec-7582-4ab8-8ffa-7a9d158e1834 req-804ba251-666b-4e9d-abc5-958872670ac2 tempest-TestInstancesWithCinderVolumes-1024417517 None] attachment_update completed successfully. Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-4e7d0557-aa73-4664-a726-23a5b457f56b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-4e7d0557-aa73-4664-a726-23a5b457f56b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-quobyte-4e7d0557-aa73-4664-a726-23a5b457f56b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-4e7d0557-aa73-4664-a726-23a5b457f56b" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff1fc2-4edc-4caa-8261-a930175710c1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:06 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b Sep 01 02:13:06 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:06 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b" returned: 0 in 0.500s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:06 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b Sep 01 02:13:06 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:07 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4e7d0557-aa73-4664-a726-23a5b457f56b" returned: 0 in 0.308s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-4e7d0557-aa73-4664-a726-23a5b457f56b" released by "delete_volume" :: held 0.910s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Created reservations ['8ba00c7e-1a14-4942-995b-1eb28f6d8c73', '5ac57fed-5883-4f4a-809e-b1003e9b04d9', '4c035ec0-9880-4123-93d3-2ee01b5bdbb3', 'b6983f97-3df9-4a11-b7ce-96bbd984012f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:07 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:07 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:07 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.345s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Deleted volume successfully. Sep 01 02:13:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e0083609-07ad-48d3-bf36-3941b1b1d429 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-4e7d0557-aa73-4664-a726-23a5b457f56b-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "cinder-quobyte-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:08 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e648e-86c1-47ee-bf3e-1dfcca7ce5f2]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:08 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 Sep 01 02:13:08 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:09 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" returned: 0 in 0.657s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:09 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2 Sep 01 02:13:09 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:09 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" returned: 0 in 0.627s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-quobyte-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2" released by "delete_volume" :: held 1.355s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:09 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Created reservations ['d193708c-6117-4ef9-81c7-0d66d5bcb71b', '5cf3c1ad-9aef-4ce0-b51d-6a7f85f6dbfe', '142c26c5-0cd1-4d3a-99f4-4a9872ec119e', 'f77cb347-4634-444d-a6e4-bf2a972a057e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:10 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:10 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:10 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.484s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:10 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Deleted volume successfully. Sep 01 02:13:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-db1f03fa-9452-4049-a3f6-8e858db06550 tempest-SnapshotDependencyTests-1512620248 None] Lock "cinder-f3e4e8c7-d981-4077-bc3e-c9d181aeb2e2-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:20 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=46,cinder:SELECT=37,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:20 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:DELETE=7,cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=79 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:24 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Flow 'volume_create_manager' (96e276e5-c687-4831-8cd0-34f13e8f1951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9fe09a-4a9d-4922-8492-ffc5d090a159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9fe09a-4a9d-4922-8492-ffc5d090a159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2036735812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01ff36f58e44e539494b4f5200e3072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:25Z,use_quota=True,user_id='15db8ebafe61428aaf60794c5bee1e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed4e0dd-fbd7-4acc-84a3-e9a6d6258fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed4e0dd-fbd7-4acc-84a3-e9a6d6258fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5777ac3d-0c40-4516-91e9-79c3ad79ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5777ac3d-0c40-4516-91e9-79c3ad79ee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5', 'volume_name': 'volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501d7d00-19a7-4c33-81a2-f2dc26f8e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501d7d00-19a7-4c33-81a2-f2dc26f8e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534e8776-c3c5-41bd-bd7e-e89b3c2aa835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:25 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Volume a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5', 'volume_size': 1} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2036735812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01ff36f58e44e539494b4f5200e3072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:25Z,use_quota=True,user_id='15db8ebafe61428aaf60794c5bee1e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Creating volume a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:25 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:25 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 1073741824 Sep 01 02:13:25 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:25 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 1073741824" returned: 0 in 0.560s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:25 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 Sep 01 02:13:25 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:26 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5" returned: 0 in 0.344s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534e8776-c3c5-41bd-bd7e-e89b3c2aa835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc11e45-1c1f-4c25-bf73-e06447b81bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Volume volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 (a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5): created successfully Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc11e45-1c1f-4c25-bf73-e06447b81bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Flow 'volume_create_manager' (96e276e5-c687-4831-8cd0-34f13e8f1951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-312b2d56-a90f-48be-bb08-9bf88be17f39 tempest-VolumeQuotasAdminTestJSON-1742208164 None] Created volume successfully. Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "cinder-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "cinder-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "cinder-quobyte-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "cinder-quobyte-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3ebddf-bbef-44b8-a98d-e91a8f68c791]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:27 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 Sep 01 02:13:27 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:27 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5" returned: 0 in 0.511s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:27 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5 Sep 01 02:13:27 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5" returned: 0 in 0.356s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "cinder-quobyte-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5" released by "delete_volume" :: held 0.937s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Created reservations ['3e291f9d-d0cd-4510-a69c-a2da2a0b4a55', '0b867bd1-b0ea-45a1-bc10-5d5ac905e508', '8d42328a-2e19-41b7-8118-d6fd812a96e6', '9021605b-2bcb-47e6-b673-b9e3368de239'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:28 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:28 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.297s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Deleted volume successfully. Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-459b5797-b69e-4c9e-a0e7-6082a6c2e18c tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "cinder-a0a93a0b-6a2e-48a7-bb4c-fd8ec8e725d5-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:28 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.290s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:13:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Flow 'volume_create_manager' (5371b816-d24c-4224-88a4-a29d5b88d790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d07ff0-d09b-4d0b-ae68-64758b8d9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d07ff0-d09b-4d0b-ae68-64758b8d9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-465945878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ec3e95-1b0d-4a5c-9601-147ae4ade02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01ff36f58e44e539494b4f5200e3072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='15db8ebafe61428aaf60794c5bee1e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d2b039-00d2-41c7-83d5-69dddb698399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d2b039-00d2-41c7-83d5-69dddb698399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78af938f-d40c-4945-b24e-31657e603852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78af938f-d40c-4945-b24e-31657e603852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ec3e95-1b0d-4a5c-9601-147ae4ade02e', 'volume_name': 'volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed336f-1c5b-4e9e-ba38-163ecb7f3547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed336f-1c5b-4e9e-ba38-163ecb7f3547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d103c04-b7f5-4133-9c54-0c19f348da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Volume d3ec3e95-1b0d-4a5c-9601-147ae4ade02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e', 'volume_size': 1} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-465945878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ec3e95-1b0d-4a5c-9601-147ae4ade02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01ff36f58e44e539494b4f5200e3072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='15db8ebafe61428aaf60794c5bee1e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Creating volume d3ec3e95-1b0d-4a5c-9601-147ae4ade02e {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:29 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:13:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e 1073741824 Sep 01 02:13:30 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e 1073741824" returned: 0 in 0.411s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e Sep 01 02:13:30 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e" returned: 0 in 0.249s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d103c04-b7f5-4133-9c54-0c19f348da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfd44c0-bc43-4038-b46e-19511d967224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Volume volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e (d3ec3e95-1b0d-4a5c-9601-147ae4ade02e): created successfully Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfd44c0-bc43-4038-b46e-19511d967224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Flow 'volume_create_manager' (5371b816-d24c-4224-88a4-a29d5b88d790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-de14dfb8-32a6-4146-a35a-dc21f594d78b tempest-VolumeQuotasAdminTestJSON-1742208164 None] Created volume successfully. Sep 01 02:13:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-25ad1bed-a8ab-4517-a680-0e8cf14ad877 tempest-VolumeQuotasAdminTestJSON-592658200 None] Transfer volume completed successfully. Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Acquiring lock "cinder-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Lock "cinder-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Acquiring lock "cinder-quobyte-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Lock "cinder-quobyte-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f44614-a7cb-46d7-acda-eb2f8c627618]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e Sep 01 02:13:32 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e" returned: 0 in 0.365s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e Sep 01 02:13:32 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Lock "cinder-quobyte-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e" released by "delete_volume" :: held 0.664s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Created reservations ['aa1c81f3-5864-4d92-ac80-8f1d4cd84ccc', 'a31fb843-5382-4561-bf43-776f71dedf2a', 'd06c7b1d-16fa-48c8-83d5-5b4ecd2d9342', '37a1b713-53bf-4698-9ff7-23703b06a2bc'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:33 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.259s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Deleted volume successfully. Sep 01 02:13:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-11380e5b-bcda-44d6-8679-33b23fadecaf tempest-VolumeQuotasAdminTestJSON-64550346 None] Lock "cinder-d3ec3e95-1b0d-4a5c-9601-147ae4ade02e-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:43 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=4 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8a10f47c-5c99-409d-a364-34a5e22625f9 req-723e2477-4cfe-455c-a56f-5dab19cdd18d tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8a10f47c-5c99-409d-a364-34a5e22625f9 req-723e2477-4cfe-455c-a56f-5dab19cdd18d tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8a10f47c-5c99-409d-a364-34a5e22625f9 req-723e2477-4cfe-455c-a56f-5dab19cdd18d tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-8a10f47c-5c99-409d-a364-34a5e22625f9 req-723e2477-4cfe-455c-a56f-5dab19cdd18d tempest-TestInstancesWithCinderVolumes-1024417517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-bac80459-4930-498d-8d6a-95fea92a4f10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eebd7d19-8291-46c3-9312-13355459e888', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:13:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-8a10f47c-5c99-409d-a364-34a5e22625f9 req-723e2477-4cfe-455c-a56f-5dab19cdd18d tempest-TestInstancesWithCinderVolumes-1024417517 None] attachment_update completed successfully. Sep 01 02:13:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-908c57e6-7c76-4791-8856-e78668fddbb8 req-d467da1d-be61-45d7-8dc9-5fa8598082c9 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-908c57e6-7c76-4791-8856-e78668fddbb8 req-d467da1d-be61-45d7-8dc9-5fa8598082c9 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-908c57e6-7c76-4791-8856-e78668fddbb8 req-d467da1d-be61-45d7-8dc9-5fa8598082c9 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-908c57e6-7c76-4791-8856-e78668fddbb8 req-d467da1d-be61-45d7-8dc9-5fa8598082c9 tempest-TestInstancesWithCinderVolumes-1024417517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-4d00ae53-2436-4394-bcd7-d460c84c4bef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59e9e6f8-f2a1-45c8-8d6c-790f12b10ed7', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:13:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-908c57e6-7c76-4791-8856-e78668fddbb8 req-d467da1d-be61-45d7-8dc9-5fa8598082c9 tempest-TestInstancesWithCinderVolumes-1024417517 None] attachment_update completed successfully. Sep 01 02:13:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-8dad3a76-5e2d-43f8-9bc4-2d7c93504b74 req-0a303b08-7ec2-4dad-850a-1239bb0f0884 tempest-TestInstancesWithCinderVolumes-1024417517 None] Terminate volume connection completed successfully. Sep 01 02:13:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-8dad3a76-5e2d-43f8-9bc4-2d7c93504b74 req-0a303b08-7ec2-4dad-850a-1239bb0f0884 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deleting attachment eebd7d19-8291-46c3-9312-13355459e888. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "cinder-bac80459-4930-498d-8d6a-95fea92a4f10-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-bac80459-4930-498d-8d6a-95fea92a4f10-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "cinder-quobyte-bac80459-4930-498d-8d6a-95fea92a4f10" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-quobyte-bac80459-4930-498d-8d6a-95fea92a4f10" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc285091-1e07-4641-ba3a-c9557a84aa4a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 Sep 01 02:13:52 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:52 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10" returned: 0 in 0.451s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10 Sep 01 02:13:52 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-bac80459-4930-498d-8d6a-95fea92a4f10" returned: 0 in 0.293s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-quobyte-bac80459-4930-498d-8d6a-95fea92a4f10" released by "delete_volume" :: held 0.795s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:53 devstack cinder-volume[87404]: WARNING cinder.quota [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1491698426-1461639569 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1491698426-1461639569, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:13:53 devstack cinder-volume[87404]: WARNING cinder.quota [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1491698426-1461639569 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1491698426-1461639569, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Created reservations ['f9ba988f-aea6-421d-b980-465af318334d', '5d2de384-c60a-43e4-8b14-a760a13fa688', 'e5dda9fb-b2be-4a65-b04d-472ef5560603', '3fefcde3-f839-4547-8c63-748f029115b8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:53 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deleted volume successfully. Sep 01 02:13:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-09d7b14e-954a-497a-a955-9c8116c36102 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-bac80459-4930-498d-8d6a-95fea92a4f10-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-527816db-b9a7-4210-b346-c187cbde7cff req-34fcad31-4abf-4a1a-8517-eee08e9cf280 tempest-TestInstancesWithCinderVolumes-1024417517 None] Terminate volume connection completed successfully. Sep 01 02:13:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-527816db-b9a7-4210-b346-c187cbde7cff req-34fcad31-4abf-4a1a-8517-eee08e9cf280 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deleting attachment 59e9e6f8-f2a1-45c8-8d6c-790f12b10ed7. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "cinder-4d00ae53-2436-4394-bcd7-d460c84c4bef-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-4d00ae53-2436-4394-bcd7-d460c84c4bef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "cinder-quobyte-4d00ae53-2436-4394-bcd7-d460c84c4bef" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-quobyte-4d00ae53-2436-4394-bcd7-d460c84c4bef" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ee1b49-390e-41df-9beb-dd8520d0359a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:57 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef Sep 01 02:13:57 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:57 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:57 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef Sep 01 02:13:57 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:57 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-4d00ae53-2436-4394-bcd7-d460c84c4bef" returned: 0 in 0.290s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-quobyte-4d00ae53-2436-4394-bcd7-d460c84c4bef" released by "delete_volume" :: held 0.763s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:57 devstack cinder-volume[87404]: WARNING cinder.quota [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339328067-1123953676 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339328067-1123953676, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:13:57 devstack cinder-volume[87404]: WARNING cinder.quota [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339328067-1123953676 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339328067-1123953676, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:13:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Created reservations ['f6eb95fa-72e4-4e2a-b015-8f36724b0d41', 'b7b52d66-53e2-4391-af78-79eedb21934c', '83a5df94-ad27-4477-90b9-8af1b7df4c06', '6ae15b59-5ae1-4f31-bde6-5ff683661cd0'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:58 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:13:58 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:58 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Deleted volume successfully. Sep 01 02:13:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47fa0fb8-f121-43c5-a86e-ba52041fc9c3 tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-4d00ae53-2436-4394-bcd7-d460c84c4bef-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-5f19c4be-b85f-43c2-a18d-b559d7e4a491 req-25806cdc-2a12-4bdb-9ce2-da2e2bb538fc tempest-TestInstancesWithCinderVolumes-1024417517 None] Terminate volume connection completed successfully. Sep 01 02:14:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-5f19c4be-b85f-43c2-a18d-b559d7e4a491 req-25806cdc-2a12-4bdb-9ce2-da2e2bb538fc tempest-TestInstancesWithCinderVolumes-1024417517 None] Deleting attachment 5bedbb12-ee22-4ce3-aae5-c361eb3d18e9. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:14:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "cinder-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "cinder-quobyte-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-quobyte-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" acquired by "delete_volume" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[032136aa-2180-465f-8760-65a513cc4ab7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e Sep 01 02:14:03 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" returned: 0 in 0.390s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e Sep 01 02:14:03 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" returned: 0 in 0.289s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-quobyte-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e" released by "delete_volume" :: held 0.737s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:03 devstack cinder-volume[87404]: WARNING cinder.quota [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-127424326-864145989 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-127424326-864145989, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:03 devstack cinder-volume[87404]: WARNING cinder.quota [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-127424326-864145989 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-127424326-864145989, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Created reservations ['049e250b-de06-4ec5-865c-273b9b9830ca', '6667b1f0-2700-44be-9d5e-3dbd9a9d9f58', 'dca0a7af-7d10-46d2-bcef-7051e7285af8', 'e903e273-9fbc-42eb-9c0b-50e586a2d3fa'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:03 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:04 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.363s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:04 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Deleted volume successfully. Sep 01 02:14:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c04f8e31-e819-47f3-981d-3aeaa8e875ae tempest-TestInstancesWithCinderVolumes-1024417517 None] Lock "cinder-3acb1b3d-8b88-4228-bc6c-73f33b3cf61e-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:13 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=52,cinder:SELECT=47,cinder:INSERT=13 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:14 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=34,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (abb206cd-60b3-4554-9418-c69e653429cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761a39e0-8ebf-49ab-a226-5771e4b7109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761a39e0-8ebf-49ab-a226-5771e4b7109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784537012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb01cd3b-5198-4e64-819e-e12022cdd082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:15Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b80585-5bff-4fa1-b1bb-7aa829e018c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b80585-5bff-4fa1-b1bb-7aa829e018c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518dd226-1fa2-41db-bd96-2b6775279d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518dd226-1fa2-41db-bd96-2b6775279d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb01cd3b-5198-4e64-819e-e12022cdd082', 'volume_name': 'volume-eb01cd3b-5198-4e64-819e-e12022cdd082', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3a4c55-da6c-45c1-a806-2cb625b4ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3a4c55-da6c-45c1-a806-2cb625b4ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0410346-3ca4-4bae-b5ef-175911b69756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Volume eb01cd3b-5198-4e64-819e-e12022cdd082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb01cd3b-5198-4e64-819e-e12022cdd082', 'volume_size': 1} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784537012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb01cd3b-5198-4e64-819e-e12022cdd082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:15Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Creating volume eb01cd3b-5198-4e64-819e-e12022cdd082 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:15 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:15 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 1073741824 Sep 01 02:14:15 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:15 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 1073741824" returned: 0 in 0.536s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:15 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 Sep 01 02:14:15 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:16 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082" returned: 0 in 0.366s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0410346-3ca4-4bae-b5ef-175911b69756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb01cd3b-5198-4e64-819e-e12022cdd082', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1edd07a-4ec4-4bd8-b95a-5ccd04c29027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:16 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Volume volume-eb01cd3b-5198-4e64-819e-e12022cdd082 (eb01cd3b-5198-4e64-819e-e12022cdd082): created successfully Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1edd07a-4ec4-4bd8-b95a-5ccd04c29027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (abb206cd-60b3-4554-9418-c69e653429cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-916a1d7d-b598-43aa-8d8b-dc354eda6fd8 tempest-VolumesActionsTest-60004950 None] Created volume successfully. Sep 01 02:14:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b68b7bb7-0a32-4055-ae46-a3631476c21f tempest-VolumesActionsTest-60004950 None] Acquiring lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082" by "attach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b68b7bb7-0a32-4055-ae46-a3631476c21f tempest-VolumesActionsTest-60004950 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082" acquired by "attach_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b68b7bb7-0a32-4055-ae46-a3631476c21f tempest-VolumesActionsTest-60004950 None] Attaching volume eb01cd3b-5198-4e64-819e-e12022cdd082 to instance 9b553831-f03e-47a6-8e1f-0006fb70f7d4 at mountpoint /dev/vdb on host None. Sep 01 02:14:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b68b7bb7-0a32-4055-ae46-a3631476c21f tempest-VolumesActionsTest-60004950 None] Attach volume completed successfully. Sep 01 02:14:17 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b68b7bb7-0a32-4055-ae46-a3631476c21f tempest-VolumesActionsTest-60004950 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082" released by "attach_volume" :: held 0.125s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-47e5ef3b-fc40-4eb3-9ad6-0617afeeefda tempest-VolumesActionsTest-1531078151 None] Terminate volume connection completed successfully. Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47e5ef3b-fc40-4eb3-9ad6-0617afeeefda tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-detach_volume" by "detach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47e5ef3b-fc40-4eb3-9ad6-0617afeeefda tempest-VolumesActionsTest-1531078151 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-47e5ef3b-fc40-4eb3-9ad6-0617afeeefda tempest-VolumesActionsTest-1531078151 None] Detaching volume eb01cd3b-5198-4e64-819e-e12022cdd082 from instance 9b553831-f03e-47a6-8e1f-0006fb70f7d4. Sep 01 02:14:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-47e5ef3b-fc40-4eb3-9ad6-0617afeeefda tempest-VolumesActionsTest-1531078151 None] Detach volume completed successfully. Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47e5ef3b-fc40-4eb3-9ad6-0617afeeefda tempest-VolumesActionsTest-1531078151 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-906f3a91-1f33-4411-86f1-7f87ece1c57d tempest-VolumesActionsTest-60004950 None] Acquiring lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-detach_volume" by "detach_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-906f3a91-1f33-4411-86f1-7f87ece1c57d tempest-VolumesActionsTest-60004950 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-906f3a91-1f33-4411-86f1-7f87ece1c57d tempest-VolumesActionsTest-60004950 None] Volume detach called, but volume not attached. Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-906f3a91-1f33-4411-86f1-7f87ece1c57d tempest-VolumesActionsTest-60004950 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Acquiring lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Acquiring lock "cinder-quobyte-eb01cd3b-5198-4e64-819e-e12022cdd082" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Lock "cinder-quobyte-eb01cd3b-5198-4e64-819e-e12022cdd082" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcc8151-f051-4477-b9b3-9349adf23b67]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 Sep 01 02:14:18 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082" returned: 0 in 0.365s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082 Sep 01 02:14:19 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-eb01cd3b-5198-4e64-819e-e12022cdd082" returned: 0 in 0.267s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Lock "cinder-quobyte-eb01cd3b-5198-4e64-819e-e12022cdd082" released by "delete_volume" :: held 0.677s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Created reservations ['c9ab8019-7ae6-453f-8d98-427946f24488', '8304a302-1125-49a3-a996-b1064fd13a64', '6e6f064e-b32c-4351-8fa5-ee80f277d4f9', '4ecdf195-5086-48b1-9f94-286ce4726e61'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:19 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.326s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:20 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Deleted volume successfully. Sep 01 02:14:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4348cc74-771d-49ef-9248-40fd02ea8610 tempest-VolumesActionsTest-60004950 None] Lock "cinder-eb01cd3b-5198-4e64-819e-e12022cdd082-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (0918f104-74d9-435c-9363-dbb9a4519136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ec1c2c-55af-49ee-92eb-23365ba5e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ec1c2c-55af-49ee-92eb-23365ba5e81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519674703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0acd51-6142-4051-a653-77c25defe912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:23Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca1dd9d-8c59-4ef9-8437-50ce6fb900e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca1dd9d-8c59-4ef9-8437-50ce6fb900e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac5eb79-e999-4381-85cd-147a7b620103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac5eb79-e999-4381-85cd-147a7b620103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0acd51-6142-4051-a653-77c25defe912', 'volume_name': 'volume-1c0acd51-6142-4051-a653-77c25defe912', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e53f01-40e1-4248-bd5f-ef2975d4da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e53f01-40e1-4248-bd5f-ef2975d4da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d31b634-a50a-47df-a990-6180a5a4326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:23 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Volume 1c0acd51-6142-4051-a653-77c25defe912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0acd51-6142-4051-a653-77c25defe912', 'volume_size': 1} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519674703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0acd51-6142-4051-a653-77c25defe912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:23Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Creating volume 1c0acd51-6142-4051-a653-77c25defe912 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:23 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:23 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 1073741824 Sep 01 02:14:23 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:23 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 1073741824" returned: 0 in 0.497s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:24 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 Sep 01 02:14:24 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Flow 'volume_create_manager' (6670dab7-02fa-41eb-82af-9fadc2a15607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adc504f-6d27-42c0-8264-982e3b5544e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adc504f-6d27-42c0-8264-982e3b5544e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce1fff6248b4cb2a1c365adfa2f731f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:24Z,use_quota=True,user_id='c77d6b6dd97340f786556047e2aa7424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0795df98-acdb-47e0-b23e-9b19721d6023),volume_type_id=0795df98-acdb-47e0-b23e-9b19721d6023)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1ac612-3172-4feb-955e-e4cac1f9115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1ac612-3172-4feb-955e-e4cac1f9115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef76eadc-eeda-4034-ae0f-9daf46c935fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:14:24 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912" returned: 0 in 0.278s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d31b634-a50a-47df-a990-6180a5a4326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0acd51-6142-4051-a653-77c25defe912', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0f016e-6677-41ec-91dc-6914bf39a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Volume volume-1c0acd51-6142-4051-a653-77c25defe912 (1c0acd51-6142-4051-a653-77c25defe912): created successfully Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0f016e-6677-41ec-91dc-6914bf39a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (0918f104-74d9-435c-9363-dbb9a4519136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b93a4a8c-ce0d-498d-a80e-ee2d69cfc79e tempest-VolumesActionsTest-60004950 None] Created volume successfully. Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef76eadc-eeda-4034-ae0f-9daf46c935fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f', 'volume_name': 'volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f', 'volume_size': 1, 'image_id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a75a1c87e62ea38e3fda500c70fe623', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ce1fff6248b4cb2a1c365adfa2f731f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa84847b71bff16aa8089e86afd20170e7436eb015cab1e3733ae2f39c4031f8df901fdbeca0a783c606ffa3cf09d4006e96c0488e453edefb38a295bcf7f713', 'id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'created_at': datetime.datetime(2026, 9, 1, 0, 14, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 14, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1277376d-9718-416b-8aaf-5d913023ff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1277376d-9718-416b-8aaf-5d913023ff75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02a0c22-1ff6-4afa-bf69-4da3f5c090f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:24 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Volume 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f', 'volume_size': 1, 'image_id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a75a1c87e62ea38e3fda500c70fe623', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ce1fff6248b4cb2a1c365adfa2f731f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa84847b71bff16aa8089e86afd20170e7436eb015cab1e3733ae2f39c4031f8df901fdbeca0a783c606ffa3cf09d4006e96c0488e453edefb38a295bcf7f713', 'id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'created_at': datetime.datetime(2026, 9, 1, 0, 14, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 14, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Trying to clone 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f from image c1dd53dc-22fd-47bc-bc4f-a08d79333c26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:14:24 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dcbe74-a80a-44ac-ace0-29b6de81c375]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:24 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD Sep 01 02:14:24 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD Sep 01 02:14:25 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Temporary image c1dd53dc-22fd-47bc-bc4f-a08d79333c26 is fetched for user c77d6b6dd97340f786556047e2aa7424. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9d0a55-7d8d-4539-87be-563cc81b5ea1]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-1c0acd51-6142-4051-a653-77c25defe912-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-1c0acd51-6142-4051-a653-77c25defe912-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:25 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD Sep 01 02:14:25 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-quobyte-1c0acd51-6142-4051-a653-77c25defe912" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-1c0acd51-6142-4051-a653-77c25defe912" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ce1b6-b612-4d83-9818-c03826c5fc69]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 Sep 01 02:14:25 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD Sep 01 02:14:26 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912" returned: 0 in 0.441s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912 Sep 01 02:14:26 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce1fff6248b4cb2a1c365adfa2f731f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:24Z,use_quota=True,user_id='c77d6b6dd97340f786556047e2aa7424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0795df98-acdb-47e0-b23e-9b19721d6023),volume_type_id=0795df98-acdb-47e0-b23e-9b19721d6023)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Creating volume 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:26 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f 1073741824 Sep 01 02:14:26 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c0acd51-6142-4051-a653-77c25defe912" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-1c0acd51-6142-4051-a653-77c25defe912" released by "delete_volume" :: held 0.804s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Created reservations ['c96eaa05-3aa2-4ba6-a5d6-9936cfb4b024', 'e799a403-0fb2-4ecf-9231-18595442ced1', '2de9397b-8f8d-44a9-a703-bea5a05985e7', '4c8e2117-5af4-439b-88d4-6b469495e7b9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:26 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f 1073741824" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f Sep 01 02:14:26 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Deleted volume successfully. Sep 01 02:14:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9fb30f64-affe-49bd-9f51-8fc216deebe7 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-1c0acd51-6142-4051-a653-77c25defe912-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:27 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" returned: 0 in 0.289s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Attempting download of c1dd53dc-22fd-47bc-bc4f-a08d79333c26 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'metadata': {}}])) to volume 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc684b-9c4e-470b-ba84-937234edc780]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:27 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706 Sep 01 02:14:27 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (ab22fb1d-e730-40ce-a248-cea2f0b41034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f568a2de-5ffe-45fc-a4ec-b0abe192bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f568a2de-5ffe-45fc-a4ec-b0abe192bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270883122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72027dde-3d62-4149-9e5b-6387995e68e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:27Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd564f52-9d61-44a2-aaa2-73fe3223a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd564f52-9d61-44a2-aaa2-73fe3223a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f585bfa-9bf7-4796-9610-c549cdd14090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f585bfa-9bf7-4796-9610-c549cdd14090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72027dde-3d62-4149-9e5b-6387995e68e0', 'volume_name': 'volume-72027dde-3d62-4149-9e5b-6387995e68e0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f4ac31-36d2-4379-9790-0ef37e8c7cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f4ac31-36d2-4379-9790-0ef37e8c7cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ca118-b3af-467e-9102-a99314d6b962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:27 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Volume 72027dde-3d62-4149-9e5b-6387995e68e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72027dde-3d62-4149-9e5b-6387995e68e0', 'volume_size': 1} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270883122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72027dde-3d62-4149-9e5b-6387995e68e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:27Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Creating volume 72027dde-3d62-4149-9e5b-6387995e68e0 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:27 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:27 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 1073741824 Sep 01 02:14:27 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:27 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:27 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706 Sep 01 02:14:27 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:27 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 1073741824" returned: 0 in 0.437s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:27 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 Sep 01 02:14:27 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:27 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706" returned: 1 in 0.385s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_5apy3706' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab55aab-d6a6-4120-ac6e-1054a7cd2df8]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD Sep 01 02:14:28 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0" returned: 0 in 0.268s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ca118-b3af-467e-9102-a99314d6b962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72027dde-3d62-4149-9e5b-6387995e68e0', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b80e08-5220-4d8b-998c-77a6176c9626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:28 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Volume volume-72027dde-3d62-4149-9e5b-6387995e68e0 (72027dde-3d62-4149-9e5b-6387995e68e0): created successfully Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b80e08-5220-4d8b-998c-77a6176c9626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (ab22fb1d-e730-40ce-a248-cea2f0b41034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-83abc870-fd09-43cc-bd3f-0baed3b1581e tempest-VolumesActionsTest-60004950 None] Created volume successfully. Sep 01 02:14:28 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD Sep 01 02:14:28 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-72027dde-3d62-4149-9e5b-6387995e68e0-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-72027dde-3d62-4149-9e5b-6387995e68e0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:28 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:28 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-quobyte-72027dde-3d62-4149-9e5b-6387995e68e0" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:28 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] c1dd53dc-22fd-47bc-bc4f-a08d79333c26 was raw, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-72027dde-3d62-4149-9e5b-6387995e68e0" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:28 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f Sep 01 02:14:28 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[46901ef2-e8e6-4cc5-a138-c2d1dec2523c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 Sep 01 02:14:28 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.295s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:14:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:14:29 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" returned: 0 in 0.458s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1dd53dc-22fd-47bc-bc4f-a08d79333c26_avk_iltudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:14:29 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f 1G Sep 01 02:14:29 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0" returned: 0 in 0.446s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0 Sep 01 02:14:29 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f 1G" returned: 0 in 0.324s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72027dde-3d62-4149-9e5b-6387995e68e0" returned: 0 in 0.288s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Downloaded image c1dd53dc-22fd-47bc-bc4f-a08d79333c26 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'metadata': {}}])) to volume 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Temporary image c1dd53dc-22fd-47bc-bc4f-a08d79333c26 for user c77d6b6dd97340f786556047e2aa7424 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Marking volume 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-72027dde-3d62-4149-9e5b-6387995e68e0" released by "delete_volume" :: held 0.796s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Copying metadata from image c1dd53dc-22fd-47bc-bc4f-a08d79333c26 to 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Creating volume glance metadata for volume 00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f backed by image c1dd53dc-22fd-47bc-bc4f-a08d79333c26 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1a75a1c87e62ea38e3fda500c70fe623', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Created reservations ['adc5e2d8-7b2d-491b-977b-064485f7f2f9', 'a602033e-0539-416f-b38a-497de6312910', '0dff3a7f-d813-4061-a712-e55997b5be36', 'ca4502c1-ed97-41cb-be68-70ae7a294971'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02a0c22-1ff6-4afa-bf69-4da3f5c090f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f', 'volume_size': 1, 'image_id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a75a1c87e62ea38e3fda500c70fe623', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ce1fff6248b4cb2a1c365adfa2f731f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa84847b71bff16aa8089e86afd20170e7436eb015cab1e3733ae2f39c4031f8df901fdbeca0a783c606ffa3cf09d4006e96c0488e453edefb38a295bcf7f713', 'id': 'c1dd53dc-22fd-47bc-bc4f-a08d79333c26', 'created_at': datetime.datetime(2026, 9, 1, 0, 14, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 14, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1dd53dc-22fd-47bc-bc4f-a08d79333c26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295e020e-e0f4-458e-8c3f-689eca995f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Volume volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f (00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f): created successfully Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295e020e-e0f4-458e-8c3f-689eca995f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Flow 'volume_create_manager' (6670dab7-02fa-41eb-82af-9fadc2a15607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d8c5a268-0998-4de5-9ff9-5dadab3e9971 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Created volume successfully. Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:29 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.285s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Deleted volume successfully. Sep 01 02:14:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2db45f66-d66d-4d9d-af3a-72f36127ca08 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-72027dde-3d62-4149-9e5b-6387995e68e0-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (d882dc33-c99d-4ff8-8914-cbd3e77a5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a78bc36-10dd-42de-8e17-3c4bd514520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a78bc36-10dd-42de-8e17-3c4bd514520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1646519821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360c886b-9bc4-48ed-9eb5-ca6418faaf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:30Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f3c31c-b16a-45f0-8cee-e604251eac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f3c31c-b16a-45f0-8cee-e604251eac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61fe8d1-52de-4e81-a416-1b5fbb4fb7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61fe8d1-52de-4e81-a416-1b5fbb4fb7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360c886b-9bc4-48ed-9eb5-ca6418faaf88', 'volume_name': 'volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8777d127-76f8-41b4-b510-0ed02a300671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8777d127-76f8-41b4-b510-0ed02a300671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1586b4e2-b76e-4189-bbc3-fdb7e635d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Volume 360c886b-9bc4-48ed-9eb5-ca6418faaf88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88', 'volume_size': 1} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1646519821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360c886b-9bc4-48ed-9eb5-ca6418faaf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:30Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Creating volume 360c886b-9bc4-48ed-9eb5-ca6418faaf88 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:30 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 1073741824 Sep 01 02:14:30 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Acquiring lock "cinder-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "cinder-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Acquiring lock "cinder-quobyte-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "cinder-quobyte-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b249f-37dd-4347-986c-436ca3ab0d06]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f Sep 01 02:14:30 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:30 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 1073741824" returned: 0 in 0.450s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 Sep 01 02:14:30 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:30 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" returned: 0 in 0.416s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f Sep 01 02:14:30 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88" returned: 0 in 0.251s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1586b4e2-b76e-4189-bbc3-fdb7e635d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ea4ec-37fd-42ad-a1d5-39417df803ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:31 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Volume volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 (360c886b-9bc4-48ed-9eb5-ca6418faaf88): created successfully Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ea4ec-37fd-42ad-a1d5-39417df803ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (d882dc33-c99d-4ff8-8914-cbd3e77a5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1a615d49-19b3-4f5c-8392-6407dc75d0f8 tempest-VolumesActionsTest-60004950 None] Created volume successfully. Sep 01 02:14:31 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "cinder-quobyte-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f" released by "delete_volume" :: held 0.719s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:31 devstack cinder-volume[87404]: WARNING cinder.quota [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:31 devstack cinder-volume[87404]: WARNING cinder.quota [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Created reservations ['f1698a00-f2b8-4218-bcaa-b0a0be278cd1', 'dfd19bd8-de60-4a17-b1be-e506d8811e9c', '6f22e87f-1bed-456f-9eb0-32f26d522d8d', '4023db81-ed0d-4ff3-b871-91b3b842d4b9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:31 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-360c886b-9bc4-48ed-9eb5-ca6418faaf88-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-360c886b-9bc4-48ed-9eb5-ca6418faaf88-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-quobyte-360c886b-9bc4-48ed-9eb5-ca6418faaf88" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-360c886b-9bc4-48ed-9eb5-ca6418faaf88" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da69b65-da20-459e-954f-ee8e2d28dc61]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 Sep 01 02:14:31 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Deleted volume successfully. Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41771ae7-0eb8-46b1-ac33-76639196f577 tempest-VolumeAndVolumeTypeFromImageTest-2024515240 None] Lock "cinder-00a6dbd6-7ba7-4af1-847d-d4ed0f2ea12f-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:31 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88 Sep 01 02:14:31 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:32 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-360c886b-9bc4-48ed-9eb5-ca6418faaf88" returned: 0 in 0.269s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-360c886b-9bc4-48ed-9eb5-ca6418faaf88" released by "delete_volume" :: held 0.740s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Created reservations ['643b4f9a-f770-40be-97cc-5e0bcae3aa31', 'ad48c20f-0235-4383-be63-9771bfd7d3a2', '630acfa8-6087-4d8e-9f0d-52e99a4c7686', 'e71e43ee-1f62-4548-a4d4-9fe9a4ceb99c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:32 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:32 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:32 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.302s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Deleted volume successfully. Sep 01 02:14:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b50220df-bc67-41f7-811f-65cbac0bc710 tempest-VolumesActionsTest-1531078151 None] Lock "cinder-360c886b-9bc4-48ed-9eb5-ca6418faaf88-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (1d02cdc9-ed32-4765-bad8-e5e8d2e29a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82c1185-4dc8-479c-a272-e9cf63445600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82c1185-4dc8-479c-a272-e9cf63445600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986748257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0621328c-4caa-423d-a96d-ed31b6822d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:33Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a6b77a-e087-4f58-82c4-6ef651274a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a6b77a-e087-4f58-82c4-6ef651274a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3931d48-b67d-47e7-b012-6e6e0576f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3931d48-b67d-47e7-b012-6e6e0576f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0621328c-4caa-423d-a96d-ed31b6822d9b', 'volume_name': 'volume-0621328c-4caa-423d-a96d-ed31b6822d9b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3b12bf-c22b-4345-9d8d-841a8d7e75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3b12bf-c22b-4345-9d8d-841a8d7e75ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e7e7ab-101b-4098-b2fb-daca88a76cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Volume 0621328c-4caa-423d-a96d-ed31b6822d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0621328c-4caa-423d-a96d-ed31b6822d9b', 'volume_size': 1} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986748257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0621328c-4caa-423d-a96d-ed31b6822d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:33Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Creating volume 0621328c-4caa-423d-a96d-ed31b6822d9b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:33 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:33 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b 1073741824 Sep 01 02:14:33 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:33 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b 1073741824" returned: 0 in 0.518s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:33 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b Sep 01 02:14:33 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:34 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e7e7ab-101b-4098-b2fb-daca88a76cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0621328c-4caa-423d-a96d-ed31b6822d9b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10f68ab-a121-4e82-97a1-c3d2b6c0bebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Volume volume-0621328c-4caa-423d-a96d-ed31b6822d9b (0621328c-4caa-423d-a96d-ed31b6822d9b): created successfully Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10f68ab-a121-4e82-97a1-c3d2b6c0bebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (1d02cdc9-ed32-4765-bad8-e5e8d2e29a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-69b64f01-1daa-4c63-b2e2-c57b019b8c4f tempest-VolumesActionsTest-60004950 None] Created volume successfully. Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-0621328c-4caa-423d-a96d-ed31b6822d9b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Lock "cinder-0621328c-4caa-423d-a96d-ed31b6822d9b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Acquiring lock "cinder-quobyte-0621328c-4caa-423d-a96d-ed31b6822d9b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-0621328c-4caa-423d-a96d-ed31b6822d9b" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ad5c2-4d6e-425c-bb50-e382be4c3d2a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:35 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b Sep 01 02:14:35 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:35 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b" returned: 0 in 0.376s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:35 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b Sep 01 02:14:35 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:36 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0621328c-4caa-423d-a96d-ed31b6822d9b" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Lock "cinder-quobyte-0621328c-4caa-423d-a96d-ed31b6822d9b" released by "delete_volume" :: held 0.693s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Created reservations ['87d16d76-e6d8-4dd2-8fc3-b345d075a878', 'f816f697-49ff-404d-ac60-f00c2fb9ea90', '39b6c5a7-5e8c-4bb8-a6ee-0240cd3c9d23', '32c2beb0-2321-40b9-b7f5-881036c2062f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:36 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:36 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (04572871-340c-48fd-96f6-ad152c60c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344a670a-6e7a-4cba-a247-246a5ac83d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344a670a-6e7a-4cba-a247-246a5ac83d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1567533948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf1da94-e522-4903-9b5d-43a37f0c8320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:36Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efd1c86-daa3-4957-9bf3-ef5bc9f691f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efd1c86-daa3-4957-9bf3-ef5bc9f691f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfa3607-1b07-4b04-a5a8-31defb55efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfa3607-1b07-4b04-a5a8-31defb55efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf1da94-e522-4903-9b5d-43a37f0c8320', 'volume_name': 'volume-6bf1da94-e522-4903-9b5d-43a37f0c8320', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8db2692-432c-4b9a-abd7-806311a952d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8db2692-432c-4b9a-abd7-806311a952d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf070e3c-d18b-423b-988c-994ebdddf53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:36 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume 6bf1da94-e522-4903-9b5d-43a37f0c8320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf1da94-e522-4903-9b5d-43a37f0c8320', 'volume_size': 1} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1567533948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf1da94-e522-4903-9b5d-43a37f0c8320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:36Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating volume 6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:36 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:36 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 1073741824 Sep 01 02:14:36 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:36 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.269s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Deleted volume successfully. Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cb50afd0-f91e-4481-831c-af38ff85a28c tempest-VolumesActionsTest-1531078151 None] Lock "cinder-0621328c-4caa-423d-a96d-ed31b6822d9b-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:36 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 1073741824" returned: 0 in 0.470s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:37 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 Sep 01 02:14:37 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (64125346-7184-4cc2-8e14-9d9e0ff7d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b72fb-8ce4-4ebd-af27-02b15e77d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b72fb-8ce4-4ebd-af27-02b15e77d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010392129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf05a23-caaf-4d45-9468-f8e5d737201e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:37Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9efd7f-2e90-494a-95d8-8b0065b0394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9efd7f-2e90-494a-95d8-8b0065b0394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b561cad9-6cc3-4cd2-b125-8dc0a86b1838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b561cad9-6cc3-4cd2-b125-8dc0a86b1838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf05a23-caaf-4d45-9468-f8e5d737201e', 'volume_name': 'volume-5bf05a23-caaf-4d45-9468-f8e5d737201e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd76418-8e85-48cb-9507-cd56d71dcb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd76418-8e85-48cb-9507-cd56d71dcb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c40fc-edf9-41ca-9beb-72352cf9fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:37 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Volume 5bf05a23-caaf-4d45-9468-f8e5d737201e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf05a23-caaf-4d45-9468-f8e5d737201e', 'volume_size': 1} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:37 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010392129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf05a23-caaf-4d45-9468-f8e5d737201e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aa61704627464198a0866f32207271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:37Z,use_quota=True,user_id='3c6ae6b79f9f4599a7b3b9a5bbb6f1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Creating volume 5bf05a23-caaf-4d45-9468-f8e5d737201e {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:37 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:37 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e 1073741824 Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf070e3c-d18b-423b-988c-994ebdddf53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf1da94-e522-4903-9b5d-43a37f0c8320', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:37 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70210208-4691-4505-a110-252c5116f640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:37 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 (6bf1da94-e522-4903-9b5d-43a37f0c8320): created successfully Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70210208-4691-4505-a110-252c5116f640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (04572871-340c-48fd-96f6-ad152c60c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9b532706-3984-4313-b836-d4c87161d50c tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created volume successfully. Sep 01 02:14:37 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e 1073741824" returned: 0 in 0.445s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:37 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e Sep 01 02:14:37 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:38 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c40fc-edf9-41ca-9beb-72352cf9fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf05a23-caaf-4d45-9468-f8e5d737201e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea1b909-0c83-4677-9d68-061248aeef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:38 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Volume volume-5bf05a23-caaf-4d45-9468-f8e5d737201e (5bf05a23-caaf-4d45-9468-f8e5d737201e): created successfully Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea1b909-0c83-4677-9d68-061248aeef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Flow 'volume_create_manager' (64125346-7184-4cc2-8e14-9d9e0ff7d2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0c725f38-715c-44e7-a0bd-cfe604785a43 tempest-VolumesActionsTest-60004950 None] Created volume successfully. Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating offline snapshot 1ba912a6-0326-4309-a0ba-1f305a9c392e of volume 6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[689a120a-cfe9-4f62-b3c1-67410c3f8f25]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Acquiring lock "cinder-5bf05a23-caaf-4d45-9468-f8e5d737201e-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:38 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 Sep 01 02:14:38 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Lock "cinder-5bf05a23-caaf-4d45-9468-f8e5d737201e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Acquiring lock "cinder-quobyte-5bf05a23-caaf-4d45-9468-f8e5d737201e" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Lock "cinder-quobyte-5bf05a23-caaf-4d45-9468-f8e5d737201e" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8997d021-59a7-445c-b1ca-f1d42b835c54]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:39 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e Sep 01 02:14:39 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:39 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:39 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e 1G Sep 01 02:14:39 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:39 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e" returned: 0 in 0.412s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:39 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e Sep 01 02:14:39 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:39 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e 1G" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:39 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e Sep 01 02:14:39 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:39 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5bf05a23-caaf-4d45-9468-f8e5d737201e" returned: 0 in 0.279s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Lock "cinder-quobyte-5bf05a23-caaf-4d45-9468-f8e5d737201e" released by "delete_volume" :: held 0.745s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Created reservations ['a9c7f2c3-6053-45a3-8895-eca4ddb849e6', 'b53f3ff5-8344-4b73-ba25-03a69b99a211', 'b9953288-863a-4ff2-8d69-369c77bfeccd', '97ff44b6-3f14-4b25-a19e-dd4936c1b033'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:39 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:39 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:39 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e" returned: 0 in 0.319s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:39 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e is being set with open permissions: ugo+rw Sep 01 02:14:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:39 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e Sep 01 02:14:39 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:40 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Deleted volume successfully. Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f23b15cf-d8fb-4bae-b18b-f863ca3c898b tempest-VolumesActionsTest-60004950 None] Lock "cinder-5bf05a23-caaf-4d45-9468-f8e5d737201e-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:40 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e" returned: 0 in 0.311s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:40 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info Sep 01 02:14:40 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:40 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info" returned: 0 in 0.281s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:40 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info is being set with open permissions: ugo+rw Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:40 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info Sep 01 02:14:40 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:40 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.info" returned: 0 in 0.285s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fceafe52-7dfc-4365-8c60-255d6999d9ee tempest-CreateVolumesFromSnapshotTest-2114373460 None] Create snapshot completed successfully Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (986a0cbc-aec3-4859-9b69-e67d05ecc348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4128e11-07dc-4ffd-a196-032524f8f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4128e11-07dc-4ffd-a196-032524f8f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905532176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b029a94c-7075-44f4-9e93-1d27051bf4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:42Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325abeb2-8e55-4f7d-8c46-a0e0415f569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325abeb2-8e55-4f7d-8c46-a0e0415f569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d412c7-e640-4274-a67f-7b684c538686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d412c7-e640-4274-a67f-7b684c538686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b029a94c-7075-44f4-9e93-1d27051bf4a3', 'volume_name': 'volume-b029a94c-7075-44f4-9e93-1d27051bf4a3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277da0c0-9967-4558-989b-1c812ed999ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277da0c0-9967-4558-989b-1c812ed999ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecd0bfb-36ec-4b6e-a2e9-68b994e7f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume b029a94c-7075-44f4-9e93-1d27051bf4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b029a94c-7075-44f4-9e93-1d27051bf4a3', 'volume_size': 1} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905532176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b029a94c-7075-44f4-9e93-1d27051bf4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:42Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating volume b029a94c-7075-44f4-9e93-1d27051bf4a3 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:42 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:42 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 1073741824 Sep 01 02:14:42 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (5bd144d8-3c77-4e97-b463-acf3eceb7088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9a597d-2472-46ae-81b0-46f8b8b646b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9a597d-2472-46ae-81b0-46f8b8b646b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-141167990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc568870-07aa-40fd-89db-998c2b18974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:43Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3020fdad-6743-42da-ad76-7af5a42a2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3020fdad-6743-42da-ad76-7af5a42a2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a141d9cc-909d-4a50-9f05-0888c6371b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a141d9cc-909d-4a50-9f05-0888c6371b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc568870-07aa-40fd-89db-998c2b18974d', 'volume_name': 'volume-fc568870-07aa-40fd-89db-998c2b18974d', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4100c6db-bec9-4198-b9f7-272b7edc076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4100c6db-bec9-4198-b9f7-272b7edc076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee78c33f-7b9a-4fa6-912b-4ea90b5c56f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume fc568870-07aa-40fd-89db-998c2b18974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc568870-07aa-40fd-89db-998c2b18974d', 'volume_size': 1} Sep 01 02:14:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (7daecdbc-9882-4811-b513-4a00a5ed9029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607f77e3-b34f-4dfc-8719-ab023a9e9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607f77e3-b34f-4dfc-8719-ab023a9e9410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1226562267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:43Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dd01a9-14ad-4c31-a542-10500118d30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dd01a9-14ad-4c31-a542-10500118d30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1511d22-7862-496f-95b1-0a54d74dd9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1511d22-7862-496f-95b1-0a54d74dd9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566', 'volume_name': 'volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f73b8e-4c19-406c-9894-5850a90dabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f73b8e-4c19-406c-9894-5850a90dabcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e30889b-c32a-4188-950a-c3073d6561c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566', 'volume_size': 1} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 1073741824" returned: 0 in 0.621s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:43 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 Sep 01 02:14:43 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (71866d4e-1585-4344-8823-ac7d6c5f1d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6978bc3-cc92-447f-807b-30276b7215cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6978bc3-cc92-447f-807b-30276b7215cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1945538055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91a36bc-3d61-43e4-b139-ed93deae7683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e69a9a-1308-44d0-b0da-a41792dd424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e69a9a-1308-44d0-b0da-a41792dd424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12484dd-d4dd-4fe2-8ffa-2993328d27a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12484dd-d4dd-4fe2-8ffa-2993328d27a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91a36bc-3d61-43e4-b139-ed93deae7683', 'volume_name': 'volume-c91a36bc-3d61-43e4-b139-ed93deae7683', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4127849e-02a6-4adf-966d-35877176173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4127849e-02a6-4adf-966d-35877176173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23b67e4-6810-4cea-a74a-4020e7b83705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume c91a36bc-3d61-43e4-b139-ed93deae7683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91a36bc-3d61-43e4-b139-ed93deae7683', 'volume_size': 1} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-141167990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc568870-07aa-40fd-89db-998c2b18974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:43Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating volume fc568870-07aa-40fd-89db-998c2b18974d {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:43 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:43 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d 1073741824 Sep 01 02:14:43 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecd0bfb-36ec-4b6e-a2e9-68b994e7f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b029a94c-7075-44f4-9e93-1d27051bf4a3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6aff035-91dc-4fe3-9347-16ff14fb9525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:43 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 (b029a94c-7075-44f4-9e93-1d27051bf4a3): created successfully Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6aff035-91dc-4fe3-9347-16ff14fb9525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (986a0cbc-aec3-4859-9b69-e67d05ecc348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4ba6943d-5968-4e21-a827-c0ab0c2414b4 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created volume successfully. Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (6fe2bd47-2d8b-437b-9588-aa4422958415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75f7a0a-267c-4636-803d-12ce14ed6b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75f7a0a-267c-4636-803d-12ce14ed6b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066332843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f3317f-1ecc-49f6-99bd-c8170db9f9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73314e99-a738-4ed1-a250-7ea080474e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73314e99-a738-4ed1-a250-7ea080474e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456305f4-8e3c-4c9e-8839-c77d66e6473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456305f4-8e3c-4c9e-8839-c77d66e6473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f3317f-1ecc-49f6-99bd-c8170db9f9a3', 'volume_name': 'volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec45219-1cba-4191-9302-1d22e72f484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec45219-1cba-4191-9302-1d22e72f484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918fada3-d111-4eb2-99c9-c802312bbb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume c6f3317f-1ecc-49f6-99bd-c8170db9f9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3', 'volume_size': 1} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:44 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d 1073741824" returned: 0 in 0.561s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:44 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d Sep 01 02:14:44 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:44 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1226562267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:43Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating volume f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:44 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee78c33f-7b9a-4fa6-912b-4ea90b5c56f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc568870-07aa-40fd-89db-998c2b18974d', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 1073741824 Sep 01 02:14:44 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6932ec9-4f61-4879-9d08-3758bec817bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume volume-fc568870-07aa-40fd-89db-998c2b18974d (fc568870-07aa-40fd-89db-998c2b18974d): created successfully Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6932ec9-4f61-4879-9d08-3758bec817bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (5bd144d8-3c77-4e97-b463-acf3eceb7088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-198ec56a-58a7-4575-9277-b87985b25044 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created volume successfully. Sep 01 02:14:45 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 1073741824" returned: 0 in 0.449s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:45 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 Sep 01 02:14:45 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:45 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1945538055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91a36bc-3d61-43e4-b139-ed93deae7683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating volume c91a36bc-3d61-43e4-b139-ed93deae7683 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:45 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e30889b-c32a-4188-950a-c3073d6561c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbfac5b-a7c4-4401-a7ea-2f3d1bcf0008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:45 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 1073741824 Sep 01 02:14:45 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:45 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 (f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566): created successfully Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbfac5b-a7c4-4401-a7ea-2f3d1bcf0008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (7daecdbc-9882-4811-b513-4a00a5ed9029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d946def9-bf28-48ea-b7a7-7472ab944b5f tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created volume successfully. Sep 01 02:14:45 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 1073741824" returned: 0 in 0.478s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:45 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 Sep 01 02:14:45 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:46 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683" returned: 0 in 0.255s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066332843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f3317f-1ecc-49f6-99bd-c8170db9f9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cba964f13924cd6957e5762fe55f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='45e95f0724824358b19fd089a4735d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Creating volume c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:46 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23b67e4-6810-4cea-a74a-4020e7b83705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91a36bc-3d61-43e4-b139-ed93deae7683', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:46 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 1073741824 Sep 01 02:14:46 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589a781d-a894-45ab-9860-2d00567042ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:46 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume volume-c91a36bc-3d61-43e4-b139-ed93deae7683 (c91a36bc-3d61-43e4-b139-ed93deae7683): created successfully Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589a781d-a894-45ab-9860-2d00567042ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (71866d4e-1585-4344-8823-ac7d6c5f1d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-88cada99-5934-470a-9c6b-537ceaba3089 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created volume successfully. Sep 01 02:14:46 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 1073741824" returned: 0 in 0.546s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:46 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 Sep 01 02:14:46 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:46 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3" returned: 0 in 0.231s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918fada3-d111-4eb2-99c9-c802312bbb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1824f7e3-c8e1-4922-8c29-52e42f34ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Volume volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 (c6f3317f-1ecc-49f6-99bd-c8170db9f9a3): created successfully Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1824f7e3-c8e1-4922-8c29-52e42f34ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Flow 'volume_create_manager' (6fe2bd47-2d8b-437b-9588-aa4422958415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-be02bcb4-5d8d-45f0-850f-3a34b0a0a7d8 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created volume successfully. Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b8e78e-e289-4fa1-81a1-36ae35ee9864]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:47 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 Sep 01 02:14:47 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:48 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3" returned: 0 in 0.339s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:48 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3 Sep 01 02:14:48 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:48 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3" returned: 0 in 0.246s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3" released by "delete_volume" :: held 0.632s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['cb32f9dc-e8ca-418a-9b58-e3aec6dbec3a', '60559af8-8f51-4243-98c8-96067722713b', 'b1a4d3d8-ef8c-4a0e-8098-60fa1211736c', '935c8ec0-4254-4e64-9064-3ab8873e1948'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:48 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:48 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:48 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.269s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleted volume successfully. Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b0ce4895-1565-465b-ae16-43782f2ccc5d tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-c6f3317f-1ecc-49f6-99bd-c8170db9f9a3-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-c91a36bc-3d61-43e4-b139-ed93deae7683-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-c91a36bc-3d61-43e4-b139-ed93deae7683-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-c91a36bc-3d61-43e4-b139-ed93deae7683" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-c91a36bc-3d61-43e4-b139-ed93deae7683" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[05437474-3125-486d-b04d-acaddb1d5389]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:49 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 Sep 01 02:14:49 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:49 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:49 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683 Sep 01 02:14:49 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:49 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c91a36bc-3d61-43e4-b139-ed93deae7683" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-c91a36bc-3d61-43e4-b139-ed93deae7683" released by "delete_volume" :: held 0.672s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['f22a4f3d-2c3a-44e9-8ce7-376ef7dda973', '7ec56b3b-b6c5-4b0f-b429-b22cb4522d25', 'fa80e633-3013-4712-9440-57116853d049', '3e81bb63-70d3-4313-97fc-283ca861bb9f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:49 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:49 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:49 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleted volume successfully. Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a8e4b8f-50bd-4146-a260-5ca06090ca09 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-c91a36bc-3d61-43e4-b139-ed93deae7683-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc6709-abf3-4166-ab57-23fee4507a1a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:50 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 Sep 01 02:14:50 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:50 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:50 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566 Sep 01 02:14:50 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:50 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566" returned: 0 in 0.255s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566" released by "delete_volume" :: held 0.675s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['3655c667-7f82-4e7a-802f-a160604da864', 'a6ffd475-fc5a-4e74-924a-3d429cbc004d', 'bf380304-ebb7-4b67-a46d-30c5d38d4e61', 'f15e4fa6-127b-4155-9096-d8cca6f5721d'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:50 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:50 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.253s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleted volume successfully. Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b836c55d-56bc-4193-af3c-62d0a1c40540 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-f3af7cdf-8f4b-4fa4-9476-5d1e53a3f566-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-fc568870-07aa-40fd-89db-998c2b18974d-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-fc568870-07aa-40fd-89db-998c2b18974d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-fc568870-07aa-40fd-89db-998c2b18974d" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-fc568870-07aa-40fd-89db-998c2b18974d" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b97522a-6c36-4456-8918-2ed0a2098d64]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d Sep 01 02:14:51 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d" returned: 0 in 0.352s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d Sep 01 02:14:51 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fc568870-07aa-40fd-89db-998c2b18974d" returned: 0 in 0.257s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-fc568870-07aa-40fd-89db-998c2b18974d" released by "delete_volume" :: held 0.655s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:51 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['8456a154-5c7c-4f7f-b8d5-a1e501277adf', '31aef1b5-be4e-46fc-a27d-37d934848151', '6dd37362-6991-4925-a5f2-58f2e2a8329a', '464147ff-a045-4f8a-b09e-5bf43c05a01b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:52 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleted volume successfully. Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45953363-4fb3-4f43-b7ac-5e84ffb16cb3 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-fc568870-07aa-40fd-89db-998c2b18974d-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-b029a94c-7075-44f4-9e93-1d27051bf4a3-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-b029a94c-7075-44f4-9e93-1d27051bf4a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-b029a94c-7075-44f4-9e93-1d27051bf4a3" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-b029a94c-7075-44f4-9e93-1d27051bf4a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3775c1-a130-4b53-9f2b-2ecbad150883]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 Sep 01 02:14:52 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3" returned: 0 in 0.402s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3 Sep 01 02:14:52 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b029a94c-7075-44f4-9e93-1d27051bf4a3" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-b029a94c-7075-44f4-9e93-1d27051bf4a3" released by "delete_volume" :: held 0.711s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['89cc1bf1-9a09-4b8d-986c-45dca2c5d2c0', 'e7114eca-a80d-4a84-bc49-3c82db44490d', '8785f306-02d5-4e12-b2be-3fd1e2d31bbf', '0f160da9-bd2c-43a9-97de-1905e9a07fea'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:53 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:53 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-1ba912a6-0326-4309-a0ba-1f305a9c392e-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:53 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-1ba912a6-0326-4309-a0ba-1f305a9c392e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-6bf1da94-e522-4903-9b5d-43a37f0c8320" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleted volume successfully. Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-6bf1da94-e522-4903-9b5d-43a37f0c8320" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-1ba912a6-0326-4309-a0ba-1f305a9c392e" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-1ba912a6-0326-4309-a0ba-1f305a9c392e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleting offline snapshot 1ba912a6-0326-4309-a0ba-1f305a9c392e of volume 6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] snapshot_file for this snap is: volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f39bf446-efa8-4249-a495-cae7e253deb0 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-b029a94c-7075-44f4-9e93-1d27051bf4a3-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a5de7-cc79-4fbb-9289-34f3fe1685f7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:53 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e Sep 01 02:14:53 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bf1da94-e522-4903-9b5d-43a37f0c8320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe27c44-aa79-45b4-8976-db114f51349d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:54 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 Sep 01 02:14:54 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:54 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320" returned: 0 in 0.366s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:54 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e Sep 01 02:14:54 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:54 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:54 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e Sep 01 02:14:54 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:55 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320.1ba912a6-0326-4309-a0ba-1f305a9c392e" returned: 0 in 0.270s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-1ba912a6-0326-4309-a0ba-1f305a9c392e" released by "_delete_snapshot" :: held 1.477s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-6bf1da94-e522-4903-9b5d-43a37f0c8320" released by "delete_snapshot" :: held 1.502s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['4016f5cf-31fb-4588-a4b1-924db2b92c65', '3cc560d8-8f19-4b99-b65e-6c2c8da6cdf0', 'ea93fded-7940-47b7-b896-d0f8da1693c9', 'db421544-31f3-492c-884a-4af91855416c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Delete snapshot completed successfully. Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e1685756-92df-4cf3-a949-559e8678c103 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-1ba912a6-0326-4309-a0ba-1f305a9c392e-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-6bf1da94-e522-4903-9b5d-43a37f0c8320-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-6bf1da94-e522-4903-9b5d-43a37f0c8320-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "cinder-quobyte-6bf1da94-e522-4903-9b5d-43a37f0c8320" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-6bf1da94-e522-4903-9b5d-43a37f0c8320" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e53bd-6648-45b2-81e9-6b4598a27b04]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:55 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 Sep 01 02:14:55 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320 Sep 01 02:14:56 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Flow 'volume_create_manager' (1c7656e5-2b03-4cd0-ad48-c4cceda52e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24a7806-cb30-407f-9ca8-fcc1e3acb273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24a7806-cb30-407f-9ca8-fcc1e3acb273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1443340587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1759bad-718a-4445-ae52-980ebe0a8141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d896b30cdf4bbcbbaef6736191a212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:56Z,use_quota=True,user_id='4b763444504440f88e3831c8a5cc1e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da56d9f2-58cd-46c7-87ee-42d7441fd744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da56d9f2-58cd-46c7-87ee-42d7441fd744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd00fee-736b-4a8d-b4dd-a533cf2577ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd00fee-736b-4a8d-b4dd-a533cf2577ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1759bad-718a-4445-ae52-980ebe0a8141', 'volume_name': 'volume-e1759bad-718a-4445-ae52-980ebe0a8141', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ac8b7e-7074-4089-8839-2b9b65423915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ac8b7e-7074-4089-8839-2b9b65423915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164ac914-7b2e-4dab-b761-e3a2b26d35b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:56 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Volume e1759bad-718a-4445-ae52-980ebe0a8141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1759bad-718a-4445-ae52-980ebe0a8141', 'volume_size': 1} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1443340587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1759bad-718a-4445-ae52-980ebe0a8141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d896b30cdf4bbcbbaef6736191a212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:56Z,use_quota=True,user_id='4b763444504440f88e3831c8a5cc1e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Creating volume e1759bad-718a-4445-ae52-980ebe0a8141 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:56 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:56 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6bf1da94-e522-4903-9b5d-43a37f0c8320" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 1073741824 Sep 01 02:14:56 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-quobyte-6bf1da94-e522-4903-9b5d-43a37f0c8320" released by "delete_volume" :: held 0.716s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Created reservations ['872b507d-d59f-48b3-bb73-c92adb1506b8', 'a5fc0267-e852-407b-8855-b57daf143660', '2204acc6-9392-4830-b1f7-cd613c11e2e2', '76150ae6-a122-4c21-bd9e-4ecd5f086967'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:14:56 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Deleted volume successfully. Sep 01 02:14:56 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 1073741824" returned: 0 in 0.507s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a6fea293-caa8-48ce-9246-fefe6dc8d024 tempest-CreateVolumesFromSnapshotTest-2114373460 None] Lock "cinder-6bf1da94-e522-4903-9b5d-43a37f0c8320-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 Sep 01 02:14:56 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:57 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141" returned: 0 in 0.250s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164ac914-7b2e-4dab-b761-e3a2b26d35b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1759bad-718a-4445-ae52-980ebe0a8141', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9b81e3-0cdd-43d5-96ff-a3dc98c1bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:57 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Volume volume-e1759bad-718a-4445-ae52-980ebe0a8141 (e1759bad-718a-4445-ae52-980ebe0a8141): created successfully Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9b81e3-0cdd-43d5-96ff-a3dc98c1bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Flow 'volume_create_manager' (1c7656e5-2b03-4cd0-ad48-c4cceda52e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ccfbfd88-0b23-41cc-ac21-7b805045eabb tempest-VolumesTransfersV355Test-581811067 None] Created volume successfully. Sep 01 02:14:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d1173ced-63db-4d45-b5ec-72c3883896b4 tempest-VolumesTransfersV355Test-1587893528 None] Transfer volume completed successfully. Sep 01 02:14:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Acquiring lock "cinder-e1759bad-718a-4445-ae52-980ebe0a8141-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-e1759bad-718a-4445-ae52-980ebe0a8141-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Acquiring lock "cinder-quobyte-e1759bad-718a-4445-ae52-980ebe0a8141" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-quobyte-e1759bad-718a-4445-ae52-980ebe0a8141" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fbafcc-2e2d-4234-ab21-82e1b3ba226f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:59 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 Sep 01 02:14:59 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141" returned: 0 in 0.387s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:00 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141 Sep 01 02:15:00 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e1759bad-718a-4445-ae52-980ebe0a8141" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-quobyte-e1759bad-718a-4445-ae52-980ebe0a8141" released by "delete_volume" :: held 0.742s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Created reservations ['19e0a901-dac6-4dd5-8414-b26d4a8b48b9', 'd3201568-3f9e-4c80-9778-282c82024773', '17517753-80cf-442a-9f31-0a4597e82933', '54a57bbc-bdcf-45bf-8356-bf8bd2a26366'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:00 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:15:00 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Deleted volume successfully. Sep 01 02:15:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b5b44d3d-8929-40c4-8934-8c86e4a6bd54 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-e1759bad-718a-4445-ae52-980ebe0a8141-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Flow 'volume_create_manager' (2e4525b4-4f01-4e79-9868-edc7c3035f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688acff2-651f-4d01-a138-5ba9459d22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688acff2-651f-4d01-a138-5ba9459d22f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-362558841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89aa574-09b4-4da9-81c4-7691795ba7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d896b30cdf4bbcbbaef6736191a212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:01Z,use_quota=True,user_id='4b763444504440f88e3831c8a5cc1e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626d78f7-06f4-465e-afcb-da7e1b799c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626d78f7-06f4-465e-afcb-da7e1b799c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf19f1d9-4a44-4458-acee-d1e02ad3ae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf19f1d9-4a44-4458-acee-d1e02ad3ae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89aa574-09b4-4da9-81c4-7691795ba7a8', 'volume_name': 'volume-d89aa574-09b4-4da9-81c4-7691795ba7a8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff96c537-1926-4501-a454-064bd772fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff96c537-1926-4501-a454-064bd772fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d03b435-cfc7-4db1-915d-9fc0cea947b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Volume d89aa574-09b4-4da9-81c4-7691795ba7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89aa574-09b4-4da9-81c4-7691795ba7a8', 'volume_size': 1} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-362558841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89aa574-09b4-4da9-81c4-7691795ba7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d896b30cdf4bbcbbaef6736191a212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:01Z,use_quota=True,user_id='4b763444504440f88e3831c8a5cc1e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Creating volume d89aa574-09b4-4da9-81c4-7691795ba7a8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:01 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:15:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:01 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 1073741824 Sep 01 02:15:01 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 1073741824" returned: 0 in 0.474s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:02 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 Sep 01 02:15:02 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d03b435-cfc7-4db1-915d-9fc0cea947b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89aa574-09b4-4da9-81c4-7691795ba7a8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37a29c0-4381-4012-bcf1-04fa55ae3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:02 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Volume volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 (d89aa574-09b4-4da9-81c4-7691795ba7a8): created successfully Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37a29c0-4381-4012-bcf1-04fa55ae3abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:02 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Flow 'volume_create_manager' (2e4525b4-4f01-4e79-9868-edc7c3035f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-bf4ffab2-97ac-43ed-b46f-68a1471918ac tempest-VolumesTransfersV355Test-581811067 None] Created volume successfully. Sep 01 02:15:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Acquiring lock "cinder-d89aa574-09b4-4da9-81c4-7691795ba7a8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-d89aa574-09b4-4da9-81c4-7691795ba7a8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Acquiring lock "cinder-quobyte-d89aa574-09b4-4da9-81c4-7691795ba7a8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:03 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-quobyte-d89aa574-09b4-4da9-81c4-7691795ba7a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:03 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[795640c0-8e84-4511-9200-a4970ba66273]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:04 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 Sep 01 02:15:04 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8" returned: 0 in 0.354s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:04 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8 Sep 01 02:15:04 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d89aa574-09b4-4da9-81c4-7691795ba7a8" returned: 0 in 0.244s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-quobyte-d89aa574-09b4-4da9-81c4-7691795ba7a8" released by "delete_volume" :: held 0.647s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Created reservations ['fd06beb6-6698-4eeb-afd7-dd2df18c7dd6', '8c69e006-9e81-486d-8691-289f77715b4e', '941fc95c-4544-4ac6-a661-094e8cdea5ea', '763391c7-2392-4ac9-bc15-5b049a7441eb'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:04 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:15:04 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.282s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:04 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Deleted volume successfully. Sep 01 02:15:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d1ed9d5d-7cad-4383-b061-d74e0c2e84b9 tempest-VolumesTransfersV355Test-1523314865 None] Lock "cinder-d89aa574-09b4-4da9-81c4-7691795ba7a8-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Flow 'volume_create_manager' (7ed5d197-bf1c-46f0-b4d6-42324f1c20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d6113f-e21d-48fb-b7b8-871af981e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d6113f-e21d-48fb-b7b8-871af981e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1954940532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620e893b-22e9-4abd-8b95-811f49d67b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff1c3fd097f4a2997995143bae1a1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:11Z,use_quota=True,user_id='67d7078549de4237b449dc295bfdcb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92db1dbd-198a-40c2-b283-54e7a0556db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92db1dbd-198a-40c2-b283-54e7a0556db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2650a051-422f-46b4-be50-45335e004e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2650a051-422f-46b4-be50-45335e004e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620e893b-22e9-4abd-8b95-811f49d67b80', 'volume_name': 'volume-620e893b-22e9-4abd-8b95-811f49d67b80', 'volume_size': 2}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee8e14-d6aa-4d4b-8502-cdff291a0a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee8e14-d6aa-4d4b-8502-cdff291a0a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8588fcbf-0d2a-4911-a043-b07c91a2cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:10 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Volume 620e893b-22e9-4abd-8b95-811f49d67b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620e893b-22e9-4abd-8b95-811f49d67b80', 'volume_size': 2} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1954940532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620e893b-22e9-4abd-8b95-811f49d67b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff1c3fd097f4a2997995143bae1a1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:11Z,use_quota=True,user_id='67d7078549de4237b449dc295bfdcb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Creating volume 620e893b-22e9-4abd-8b95-811f49d67b80 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:10 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:15:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 2147483648 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:10 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 2147483648 Sep 01 02:15:10 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:11 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 2147483648" returned: 0 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:11 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 Sep 01 02:15:11 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:11 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80" returned: 0 in 0.231s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8588fcbf-0d2a-4911-a043-b07c91a2cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620e893b-22e9-4abd-8b95-811f49d67b80', 'volume_size': 2}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9b8609-b069-4f17-b7c8-4a082a19f059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:11 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Volume volume-620e893b-22e9-4abd-8b95-811f49d67b80 (620e893b-22e9-4abd-8b95-811f49d67b80): created successfully Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9b8609-b069-4f17-b7c8-4a082a19f059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Flow 'volume_create_manager' (7ed5d197-bf1c-46f0-b4d6-42324f1c20dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:11 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ec8f04be-fc90-495b-8850-8ddb5f2855cc tempest-VolumesCloneNegativeTest-1065904062 None] Created volume successfully. Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Acquiring lock "cinder-620e893b-22e9-4abd-8b95-811f49d67b80-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Lock "cinder-620e893b-22e9-4abd-8b95-811f49d67b80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Acquiring lock "cinder-quobyte-620e893b-22e9-4abd-8b95-811f49d67b80" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Lock "cinder-quobyte-620e893b-22e9-4abd-8b95-811f49d67b80" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[04696253-a16d-47f2-9793-0248fb7f0621]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:11 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 Sep 01 02:15:11 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:12 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:12 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80 Sep 01 02:15:12 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:12 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-620e893b-22e9-4abd-8b95-811f49d67b80" returned: 0 in 0.240s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Lock "cinder-quobyte-620e893b-22e9-4abd-8b95-811f49d67b80" released by "delete_volume" :: held 0.621s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Created reservations ['6f87e9ae-0f1b-4b7d-9044-efed563b0943', '241528f6-4085-4670-bd8a-b203ff4e29a5', '763b3f01-fd8b-4bdd-a466-1c1837430d2e', 'ad1c1d4a-f895-4005-914f-7df0b88ca9aa'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:12 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:15:12 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:12 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.255s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Deleted volume successfully. Sep 01 02:15:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-375b726e-ab1d-4409-9a11-5b2d412bf32a tempest-VolumesCloneNegativeTest-1065904062 None] Lock "cinder-620e893b-22e9-4abd-8b95-811f49d67b80-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=144,cinder:UPDATE=195,cinder:DELETE=15,cinder:INSERT=44 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=182,cinder:SELECT=127,cinder:INSERT=53,cinder:DELETE=18 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Flow 'volume_create_manager' (97371d37-bd04-48cf-adcf-a6f97e205792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde19618-f35e-4e57-87e9-e7284dbd9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde19618-f35e-4e57-87e9-e7284dbd9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-764125995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06883369d05b49c9bd05e63232b0567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:16Z,use_quota=True,user_id='9af3c6627caf43c9a224a16f7e57bdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d3843d-a481-4edd-adf3-ac0e2e8727f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d3843d-a481-4edd-adf3-ac0e2e8727f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16539052-d50e-4042-ab94-41f01a34717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:15 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16539052-d50e-4042-ab94-41f01a34717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b', 'volume_name': 'volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f85df06-bf1e-4235-b87a-f32ba6c92ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f85df06-bf1e-4235-b87a-f32ba6c92ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6068edc-f7db-40d9-94e5-23a468b275a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:16 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Volume ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Trying to clone ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:15:16 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc7d77c-6d14-4e09-89f1-6d00d5a6d0d3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:16 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD Sep 01 02:15:16 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:16 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 is fetched for user 9af3c6627caf43c9a224a16f7e57bdd0. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7300035d-d6a1-473d-b1d5-4a99b7d6a219]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:17 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD Sep 01 02:15:17 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:17 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-764125995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06883369d05b49c9bd05e63232b0567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:16Z,use_quota=True,user_id='9af3c6627caf43c9a224a16f7e57bdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Creating volume ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:17 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:17 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 1073741824 Sep 01 02:15:17 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:17 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 1073741824" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:17 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b Sep 01 02:15:17 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:18 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Attempting download of d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e72ef-0b70-4c36-9a7f-b1239a19f568]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:18 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv Sep 01 02:15:18 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:18 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv" returned: 0 in 0.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:18 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv Sep 01 02:15:18 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:18 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv" returned: 1 in 0.328s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_r0708ccv' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3919a3cb-1d46-4fb4-9c9c-658893653bfd]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:18 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD Sep 01 02:15:18 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:19 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:19 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 was qcow2, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:15:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:19 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b Sep 01 02:15:19 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:20 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" returned: 0 in 1.643s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:20 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487_m6ghok04devstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:15:20 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Converted 112.00 MB image at 68.10 MB/s Sep 01 02:15:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:20 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 1G Sep 01 02:15:20 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:21 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 1G" returned: 0 in 0.322s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Downloaded image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 ((None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}])) to volume ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Temporary image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 for user 9af3c6627caf43c9a224a16f7e57bdd0 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Marking volume ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Copying metadata from image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 to ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Creating volume glance metadata for volume ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b backed by image d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6068edc-f7db-40d9-94e5-23a468b275a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b', 'volume_size': 1, 'image_id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab8f6e8197ce477bb63380b9eb3d244a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd33c70ef-0f8d-4bc0-9ec4-33bbd54f7487', 'created_at': datetime.datetime(2026, 8, 31, 23, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d33c70ef-0f8d-4bc0-9ec4-33bbd54f7487/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba59d946-fe7b-4120-ab9c-e9f02a29302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Volume volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b (ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b): created successfully Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba59d946-fe7b-4120-ab9c-e9f02a29302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Flow 'volume_create_manager' (97371d37-bd04-48cf-adcf-a6f97e205792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6f36c707-35a3-49ad-914b-a4428ff06e1c tempest-VolumesExtendTest-174372890 None] Created volume successfully. Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f761ab-bf6d-4c4d-a822-16d3937de77b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:22 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b Sep 01 02:15:22 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:22 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" returned: 0 in 0.362s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 2G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b 2G" returned: 0 in 0.082s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.466s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:22 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f282a9fc-5e08-4076-b8a4-79aadf6ae176 tempest-VolumesExtendTest-174372890 None] Extend volume completed successfully. Sep 01 02:15:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Lock "cinder-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-quobyte-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a0fbe-78ab-4f98-8733-765ab37f2610]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:23 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b Sep 01 02:15:23 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:24 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" returned: 0 in 0.372s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:24 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b Sep 01 02:15:24 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:24 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b" released by "delete_volume" :: held 0.657s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Created reservations ['69e10564-8da3-49c5-aeb7-fc47a05f5b12', '6ef0c709-2cd3-458f-badc-a5a54f7adb56', 'f5d76b53-4eb8-4b7f-9143-92d71254e2f7', '42b394ee-091b-4291-8ffd-a4e1fe9424c3'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:24 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:15:24 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:24 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Deleted volume successfully. Sep 01 02:15:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b151bdc2-6955-4568-903e-31d6058f1f0a tempest-VolumesExtendTest-174372890 None] Lock "cinder-ac1b6b6c-c5c3-44e0-9fc8-e1589ebed03b-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Flow 'volume_create_manager' (f6a69998-0e97-41f7-94d3-9803bf815c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b168ac03-d7d5-456c-ab4e-53140577dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b168ac03-d7d5-456c-ab4e-53140577dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-524596515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc696553-fb4f-4ec3-bd3f-8d8826cd9246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06883369d05b49c9bd05e63232b0567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:25Z,use_quota=True,user_id='9af3c6627caf43c9a224a16f7e57bdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2612cec6-81d4-4b15-900c-e395abdf3680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2612cec6-81d4-4b15-900c-e395abdf3680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eaebff-2e9d-4bb3-aefc-72bdcdf34cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eaebff-2e9d-4bb3-aefc-72bdcdf34cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc696553-fb4f-4ec3-bd3f-8d8826cd9246', 'volume_name': 'volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b480fcce-8425-4e51-90d0-a4c8dde96640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b480fcce-8425-4e51-90d0-a4c8dde96640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3a98c6-96c7-4b15-96b4-7f7c020e3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:25 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Volume dc696553-fb4f-4ec3-bd3f-8d8826cd9246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246', 'volume_size': 1} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-524596515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc696553-fb4f-4ec3-bd3f-8d8826cd9246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06883369d05b49c9bd05e63232b0567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:25Z,use_quota=True,user_id='9af3c6627caf43c9a224a16f7e57bdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Creating volume dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:25 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:25 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 1073741824 Sep 01 02:15:25 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:25 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 1073741824" returned: 0 in 0.399s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:25 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 Sep 01 02:15:25 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:25 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" returned: 0 in 0.271s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3a98c6-96c7-4b15-96b4-7f7c020e3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a6ca0f-d577-40bf-8f91-43d4a62c0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Volume volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 (dc696553-fb4f-4ec3-bd3f-8d8826cd9246): created successfully Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a6ca0f-d577-40bf-8f91-43d4a62c0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Flow 'volume_create_manager' (f6a69998-0e97-41f7-94d3-9803bf815c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-295363fb-c901-4ac8-994a-c0b11f2119f5 tempest-VolumesExtendTest-174372890 None] Created volume successfully. Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Creating offline snapshot 5c5aa771-fb6c-403f-85f7-0f4405a618d8 of volume dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[850fc51c-08bd-407b-901f-2c0db2a53e2d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:26 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 Sep 01 02:15:26 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:26 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:26 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 1G Sep 01 02:15:26 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:27 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 1G" returned: 0 in 0.413s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:27 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 Sep 01 02:15:27 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:27 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:27 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 is being set with open permissions: ugo+rw Sep 01 02:15:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:27 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 Sep 01 02:15:27 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:27 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:27 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info Sep 01 02:15:27 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:28 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info" returned: 0 in 0.270s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:28 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info is being set with open permissions: ugo+rw Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:28 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info Sep 01 02:15:28 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:28 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.info" returned: 0 in 0.235s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-99888dff-d6d8-4888-a6d6-f0beaa5220f4 tempest-VolumesExtendTest-174372890 None] Create snapshot completed successfully Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b08a39-bc3b-4729-9778-685129f9b05e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:28 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:15:28 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:28 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 Sep 01 02:15:28 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:28 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.289s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:15:28 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 2G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 2G" returned: 0 in 0.127s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.558s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-02b5aa60-6515-40a4-b551-50ea1fd610d8 tempest-VolumesExtendTest-174372890 None] Extend volume completed successfully. Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-5c5aa771-fb6c-403f-85f7-0f4405a618d8-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Lock "cinder-5c5aa771-fb6c-403f-85f7-0f4405a618d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-quobyte-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-quobyte-5c5aa771-fb6c-403f-85f7-0f4405a618d8" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-5c5aa771-fb6c-403f-85f7-0f4405a618d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Deleting offline snapshot 5c5aa771-fb6c-403f-85f7-0f4405a618d8 of volume dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] snapshot_file for this snap is: volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[50021e71-8339-4814-8384-0f73db256543]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:29 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 Sep 01 02:15:29 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:30 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8" returned: 0 in 0.392s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a476e34b-7a3b-485f-a02f-534eebcfcc09]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:30 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 Sep 01 02:15:30 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:30 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" returned: 0 in 0.397s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:30 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 Sep 01 02:15:30 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:31 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8" returned: 0 in 0.383s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:31 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8 Sep 01 02:15:31 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:31 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246.5c5aa771-fb6c-403f-85f7-0f4405a618d8" returned: 0 in 0.295s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-5c5aa771-fb6c-403f-85f7-0f4405a618d8" released by "_delete_snapshot" :: held 1.569s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" released by "delete_snapshot" :: held 1.592s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Created reservations ['3d07d98a-9f1f-45d2-a22c-d5e6ccde0dbb', 'd1002b20-db07-4723-8b79-2b0c9079890b', 'a87149be-2b2f-4964-b267-a78ca5e12ff8', 'e8771dec-c49b-4d19-aaf8-5bef625ea038'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:31 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Delete snapshot completed successfully. Sep 01 02:15:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4530c89b-a352-40a7-80a4-4f68b5db8626 tempest-VolumesExtendTest-174372890 None] Lock "cinder-5c5aa771-fb6c-403f-85f7-0f4405a618d8-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-dc696553-fb4f-4ec3-bd3f-8d8826cd9246-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Lock "cinder-dc696553-fb4f-4ec3-bd3f-8d8826cd9246-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Acquiring lock "cinder-quobyte-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b019b208-b7d3-4289-93b6-3cfc0ae09f27]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:32 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 Sep 01 02:15:32 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:32 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" returned: 0 in 0.391s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:32 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246 Sep 01 02:15:32 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:32 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Lock "cinder-quobyte-dc696553-fb4f-4ec3-bd3f-8d8826cd9246" released by "delete_volume" :: held 0.719s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Created reservations ['21b430f8-0bb4-43aa-86dd-359dc0475f4f', 'ba542519-8a3b-4d50-a882-4c39c4f73edb', 'ca385afc-e430-4206-a814-92b4ef1ba893', 'e8090638-ce41-4d56-b108-3b6f7e270412'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:32 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:15:32 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:33 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.303s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:33 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Deleted volume successfully. Sep 01 02:15:33 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-df34f377-9766-4e6a-9e0a-780a434db9c1 tempest-VolumesExtendTest-174372890 None] Lock "cinder-dc696553-fb4f-4ec3-bd3f-8d8826cd9246-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:43 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=33,cinder:INSERT=14,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (715d45cf-2f67-4909-8c8d-91d2cea9fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d847424-f78e-49d9-9a9a-4fa5ef4362f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d847424-f78e-49d9-9a9a-4fa5ef4362f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-436186300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59473fb-3917-48c4-b406-2b128141438f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:49Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e75d9a-3e8b-45b8-ab65-05454daa861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e75d9a-3e8b-45b8-ab65-05454daa861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111197a7-e3e9-46c5-bad9-ada04ad66230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111197a7-e3e9-46c5-bad9-ada04ad66230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59473fb-3917-48c4-b406-2b128141438f', 'volume_name': 'volume-a59473fb-3917-48c4-b406-2b128141438f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a758b66-7138-4945-a397-043a20f13b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a758b66-7138-4945-a397-043a20f13b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7654cb7e-2b09-406e-be58-7367e2045599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume a59473fb-3917-48c4-b406-2b128141438f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59473fb-3917-48c4-b406-2b128141438f', 'volume_size': 1} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-436186300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59473fb-3917-48c4-b406-2b128141438f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:49Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating volume a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:48 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:15:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:48 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f 1073741824 Sep 01 02:15:48 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:49 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f 1073741824" returned: 0 in 0.421s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:49 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f Sep 01 02:15:49 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:49 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7654cb7e-2b09-406e-be58-7367e2045599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59473fb-3917-48c4-b406-2b128141438f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e9a200-257d-498c-a3b7-75d439bba0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume volume-a59473fb-3917-48c4-b406-2b128141438f (a59473fb-3917-48c4-b406-2b128141438f): created successfully Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e9a200-257d-498c-a3b7-75d439bba0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (715d45cf-2f67-4909-8c8d-91d2cea9fbad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4ef2a417-8cd8-40ae-af63-c5f973a22707 tempest-VolumesSnapshotTestJSON-2010914109 None] Created volume successfully. Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Creating offline snapshot 0d732812-00e3-4513-83d4-04e3b5b71fa9 of volume a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10f8d6a-35fa-4ea0-9c9b-7ef5509e887d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f Sep 01 02:15:50 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 1G Sep 01 02:15:50 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 1G" returned: 0 in 0.410s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a59473fb-3917-48c4-b406-2b128141438f -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a59473fb-3917-48c4-b406-2b128141438f -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 Sep 01 02:15:50 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:51 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a59473fb-3917-48c4-b406-2b128141438f -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 is being set with open permissions: ugo+rw Sep 01 02:15:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:51 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 Sep 01 02:15:51 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:51 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9" returned: 0 in 0.268s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:51 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info Sep 01 02:15:51 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:51 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info is being set with open permissions: ugo+rw Sep 01 02:15:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:51 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info Sep 01 02:15:51 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:52 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.info" returned: 0 in 0.271s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-83600864-8430-486d-8e81-16a815931def tempest-VolumesSnapshotTestJSON-2010914109 None] Create snapshot completed successfully Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-0d732812-00e3-4513-83d4-04e3b5b71fa9-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-0d732812-00e3-4513-83d4-04e3b5b71fa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-a59473fb-3917-48c4-b406-2b128141438f" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-a59473fb-3917-48c4-b406-2b128141438f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-0d732812-00e3-4513-83d4-04e3b5b71fa9" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-0d732812-00e3-4513-83d4-04e3b5b71fa9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Deleting offline snapshot 0d732812-00e3-4513-83d4-04e3b5b71fa9 of volume a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] snapshot_file for this snap is: volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b11054-91b2-4c8d-8aaa-182dea1eff61]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:52 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 Sep 01 02:15:52 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:52 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a59473fb-3917-48c4-b406-2b128141438f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb738cd-09e9-430f-80c7-62e0c93ced7d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:53 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f Sep 01 02:15:53 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:53 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f" returned: 0 in 0.358s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:53 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 Sep 01 02:15:53 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:53 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9" returned: 0 in 0.357s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:53 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9 Sep 01 02:15:53 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:53 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f.0d732812-00e3-4513-83d4-04e3b5b71fa9" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-0d732812-00e3-4513-83d4-04e3b5b71fa9" released by "_delete_snapshot" :: held 1.460s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-a59473fb-3917-48c4-b406-2b128141438f" released by "delete_snapshot" :: held 1.485s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['18d98518-dc7e-4c14-9ea5-6cc5c47e7a59', 'bf57412b-1548-405e-98b4-a1a4eb09ac77', '3d000ee3-f209-4917-93a0-08cc92ed1915', '3c95b416-df1f-4929-88e4-af3ff04cef38'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Delete snapshot completed successfully. Sep 01 02:15:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02af5aed-e889-43ab-bb5d-372cd14244ea tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-0d732812-00e3-4513-83d4-04e3b5b71fa9-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (cfa34a3d-d0c4-48b0-90c9-dbeb2e2581cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b259dd74-6059-4dd8-900e-37835500c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b259dd74-6059-4dd8-900e-37835500c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1363129195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b0e2f6-152f-4148-946e-7f565b8ae8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:55Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec95618-f958-4d41-a3c0-77eb5a201264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec95618-f958-4d41-a3c0-77eb5a201264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b226f21a-12a7-43e3-ba9a-6f9b7f1bbf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b226f21a-12a7-43e3-ba9a-6f9b7f1bbf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b0e2f6-152f-4148-946e-7f565b8ae8cb', 'volume_name': 'volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ea6197-d012-4f88-95d2-8bff6fbef1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ea6197-d012-4f88-95d2-8bff6fbef1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01415cf2-6660-4c3b-b7ea-7c00d8eb2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Volume 35b0e2f6-152f-4148-946e-7f565b8ae8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb', 'volume_size': 1} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1363129195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b0e2f6-152f-4148-946e-7f565b8ae8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:55Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Creating volume 35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:55 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:55 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb 1073741824 Sep 01 02:15:55 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb 1073741824" returned: 0 in 0.417s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:55 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb Sep 01 02:15:55 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb" returned: 0 in 0.238s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01415cf2-6660-4c3b-b7ea-7c00d8eb2c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055e2c2e-8d0f-4916-8780-fa4a1e8158fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Volume volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb (35b0e2f6-152f-4148-946e-7f565b8ae8cb): created successfully Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055e2c2e-8d0f-4916-8780-fa4a1e8158fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (cfa34a3d-d0c4-48b0-90c9-dbeb2e2581cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c025f407-7035-4187-9c37-916b1a3ffb5a tempest-VolumesSnapshotTestJSON-2010914109 None] Created volume successfully. Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating offline snapshot dbe3edb7-1e9a-4f0f-a727-44c141ed096a of volume 35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e97903c-1e19-4620-88c8-eed380f72dde]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb Sep 01 02:15:56 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a 1G Sep 01 02:15:56 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a 1G" returned: 0 in 0.364s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a Sep 01 02:15:57 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:57 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a" returned: 0 in 0.266s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:57 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a is being set with open permissions: ugo+rw Sep 01 02:15:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a Sep 01 02:15:57 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:57 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info Sep 01 02:15:57 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:57 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info" returned: 0 in 0.244s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:57 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info is being set with open permissions: ugo+rw Sep 01 02:15:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info Sep 01 02:15:57 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:58 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.info" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0e18ea4f-5e71-4098-bf63-6d99874ee990 tempest-VolumesSnapshotTestJSON-2010914109 None] Create snapshot completed successfully Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (46ad10b6-a189-41d8-9a63-8aa511bc2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f4180-f1aa-41df-aa98-a46b56ef81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f4180-f1aa-41df-aa98-a46b56ef81c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1568477412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e34700-938a-457d-92ee-33cca70fd558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dbe3edb7-1e9a-4f0f-a727-44c141ed096a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:59Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebeae9cd-76d4-4465-953e-77c86238987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebeae9cd-76d4-4465-953e-77c86238987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ea1038-2ebb-4969-843c-7b99eb903495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ea1038-2ebb-4969-843c-7b99eb903495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7e34700-938a-457d-92ee-33cca70fd558', 'volume_name': 'volume-d7e34700-938a-457d-92ee-33cca70fd558', 'volume_size': 2, 'snapshot_id': 'dbe3edb7-1e9a-4f0f-a727-44c141ed096a'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a893538e-da3f-4bc3-b364-34861b10a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a893538e-da3f-4bc3-b364-34861b10a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b635f4a-85cc-4148-bfd4-ced54f88887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:58 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume d7e34700-938a-457d-92ee-33cca70fd558: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7e34700-938a-457d-92ee-33cca70fd558', 'volume_size': 2, 'snapshot_id': 'dbe3edb7-1e9a-4f0f-a727-44c141ed096a'} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-dbe3edb7-1e9a-4f0f-a727-44c141ed096a-d7e34700-938a-457d-92ee-33cca70fd558" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-dbe3edb7-1e9a-4f0f-a727-44c141ed096a-d7e34700-938a-457d-92ee-33cca70fd558" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating volume d7e34700-938a-457d-92ee-33cca70fd558 from snapshot dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-d7e34700-938a-457d-92ee-33cca70fd558" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-d7e34700-938a-457d-92ee-33cca70fd558" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] snapshot: dbe3edb7-1e9a-4f0f-a727-44c141ed096a, volume: d7e34700-938a-457d-92ee-33cca70fd558, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3b856-3176-425f-8489-8c884d5d657b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a Sep 01 02:15:59 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:59 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d24a05d-6ee8-4281-b9a0-6aae64b0c2c2]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb Sep 01 02:15:59 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:59 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:15:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 Sep 01 02:15:59 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:04 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558" returned: 0 in 4.334s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:04 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Converted 1024.00 MB image at 236.19 MB/s Sep 01 02:16:04 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 is being set with open permissions: ugo+rw Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:04 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 Sep 01 02:16:04 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:04 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558" returned: 0 in 0.295s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-d7e34700-938a-457d-92ee-33cca70fd558" released by "_copy_volume_from_snapshot" :: held 5.420s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-dbe3edb7-1e9a-4f0f-a727-44c141ed096a-d7e34700-938a-457d-92ee-33cca70fd558" released by "_create_volume_from_snapshot" :: held 5.520s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.534s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b635f4a-85cc-4148-bfd4-ced54f88887f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e34700-938a-457d-92ee-33cca70fd558', 'volume_size': 2, 'snapshot_id': 'dbe3edb7-1e9a-4f0f-a727-44c141ed096a'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01a6d4e-4d7b-4dad-9240-d8571138f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume volume-d7e34700-938a-457d-92ee-33cca70fd558 (d7e34700-938a-457d-92ee-33cca70fd558): created successfully Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01a6d4e-4d7b-4dad-9240-d8571138f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (46ad10b6-a189-41d8-9a63-8aa511bc2f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-96971d54-c624-4fd9-a7ef-bf3e040f6b01 tempest-VolumesSnapshotTestJSON-2010914109 None] Created volume successfully. Sep 01 02:16:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-d7e34700-938a-457d-92ee-33cca70fd558-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-d7e34700-938a-457d-92ee-33cca70fd558-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-d7e34700-938a-457d-92ee-33cca70fd558" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-d7e34700-938a-457d-92ee-33cca70fd558" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9730195c-0704-4c68-a3d7-e38cf1feaf12]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:05 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 Sep 01 02:16:05 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558" returned: 0 in 0.361s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558 Sep 01 02:16:06 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d7e34700-938a-457d-92ee-33cca70fd558" returned: 0 in 0.246s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-d7e34700-938a-457d-92ee-33cca70fd558" released by "delete_volume" :: held 0.647s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['39154859-cc3f-442b-b240-cb4e3a700227', 'a5f4baa4-20c6-4404-b51f-30e7b948324f', 'a52c549d-98a8-4140-b2ea-9f923491b99f', '510208c3-7d9c-450d-a08c-c0435b966f77'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:16:06 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.243s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Deleted volume successfully. Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c96a317a-3ae9-4d04-a343-2dd59902b1fc tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-d7e34700-938a-457d-92ee-33cca70fd558-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-dbe3edb7-1e9a-4f0f-a727-44c141ed096a-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-dbe3edb7-1e9a-4f0f-a727-44c141ed096a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-35b0e2f6-152f-4148-946e-7f565b8ae8cb" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-35b0e2f6-152f-4148-946e-7f565b8ae8cb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-dbe3edb7-1e9a-4f0f-a727-44c141ed096a" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-dbe3edb7-1e9a-4f0f-a727-44c141ed096a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Deleting offline snapshot dbe3edb7-1e9a-4f0f-a727-44c141ed096a of volume 35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] snapshot_file for this snap is: volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[128de21e-f34a-4c50-864d-bcc8914a722b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:07 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a Sep 01 02:16:07 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:07 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a" returned: 0 in 0.366s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a26d636-ed7d-49fd-bc2d-5457f843c3ef]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:07 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb Sep 01 02:16:07 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:07 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb" returned: 0 in 0.562s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a Sep 01 02:16:08 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a Sep 01 02:16:08 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb.dbe3edb7-1e9a-4f0f-a727-44c141ed096a" returned: 0 in 0.256s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-dbe3edb7-1e9a-4f0f-a727-44c141ed096a" released by "_delete_snapshot" :: held 1.632s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-35b0e2f6-152f-4148-946e-7f565b8ae8cb" released by "delete_snapshot" :: held 1.654s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['01dbc778-d4a9-4788-b9bb-956d2602e2df', 'e84b97fe-b6c0-4d87-b42f-a041814541c8', '7e4bdc2c-f7b8-4906-85c9-1f1bcee3ac3d', '21ccf8ff-bb53-47fe-aad0-360b1070ae1b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Delete snapshot completed successfully. Sep 01 02:16:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b7148f5c-5c2e-4844-8f02-2e017076b9a4 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-dbe3edb7-1e9a-4f0f-a727-44c141ed096a-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-35b0e2f6-152f-4148-946e-7f565b8ae8cb-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-35b0e2f6-152f-4148-946e-7f565b8ae8cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-35b0e2f6-152f-4148-946e-7f565b8ae8cb" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-35b0e2f6-152f-4148-946e-7f565b8ae8cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33db62-1e4d-41dc-a691-b3556c24e7d1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:09 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb Sep 01 02:16:09 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:09 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb" returned: 0 in 0.415s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:09 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb Sep 01 02:16:09 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:09 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-35b0e2f6-152f-4148-946e-7f565b8ae8cb" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-35b0e2f6-152f-4148-946e-7f565b8ae8cb" released by "delete_volume" :: held 0.736s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['20ea78b9-9ed3-4a5f-b914-68b0f6cab81f', '14d66bcb-f4c1-4d52-82c5-5d87ed3363d3', '176c8157-4599-4e51-9829-b52a1c43940d', 'c5fb0e38-35c7-4b8d-a7ad-a3fa1b87636f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:10 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:16:10 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:10 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:10 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Deleted volume successfully. Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c4143fc1-63d2-4919-8e11-365a9e9fac79 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-35b0e2f6-152f-4148-946e-7f565b8ae8cb-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (202b13f5-41f9-40d3-9b74-227d81d98949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e377fa05-8c96-4556-90dc-121af0b1a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e377fa05-8c96-4556-90dc-121af0b1a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1842293092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c9f334-9e4b-435b-a02c-2eb9d928f3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:11Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de66ec17-93e4-48ca-8279-1fbbbf8e9e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de66ec17-93e4-48ca-8279-1fbbbf8e9e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0bce77-202d-4bde-af9f-08d45d38de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0bce77-202d-4bde-af9f-08d45d38de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c9f334-9e4b-435b-a02c-2eb9d928f3b4', 'volume_name': 'volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37124126-1d00-406a-b659-ddbb051f7db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37124126-1d00-406a-b659-ddbb051f7db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1224c2e1-ac9b-42be-b75c-dcb5d89e9291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:10 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Volume 26c9f334-9e4b-435b-a02c-2eb9d928f3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4', 'volume_size': 1} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1842293092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c9f334-9e4b-435b-a02c-2eb9d928f3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:11Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Creating volume 26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:10 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:16:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:11 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 1073741824 Sep 01 02:16:11 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:11 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 1073741824" returned: 0 in 0.427s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:11 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 Sep 01 02:16:11 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:11 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1224c2e1-ac9b-42be-b75c-dcb5d89e9291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef4edf5-9e66-4034-a2a8-812ac17d616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:11 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Volume volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 (26c9f334-9e4b-435b-a02c-2eb9d928f3b4): created successfully Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef4edf5-9e66-4034-a2a8-812ac17d616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (202b13f5-41f9-40d3-9b74-227d81d98949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:11 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-507f76f3-39b2-4d82-9ba9-0f3a8248830b tempest-VolumesSnapshotTestJSON-2010914109 None] Created volume successfully. Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating offline snapshot 3252b653-a4be-430f-8946-7098df932ce1 of volume 26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a8b219-63ff-4cb5-8414-a605061748df]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:12 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 Sep 01 02:16:12 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:12 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" returned: 0 in 0.359s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:12 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 1G Sep 01 02:16:12 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:12 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 1G" returned: 0 in 0.396s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:12 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 Sep 01 02:16:12 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1" returned: 0 in 0.279s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 is being set with open permissions: ugo+rw Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 Sep 01 02:16:13 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info Sep 01 02:16:13 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info is being set with open permissions: ugo+rw Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info Sep 01 02:16:13 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.info" returned: 0 in 0.239s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:13 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-22b8c717-0252-44ea-a19b-e22a471d3d28 tempest-VolumesSnapshotTestJSON-2010914109 None] Create snapshot completed successfully Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (60ad6e4d-c584-4331-a1e9-85399a94f31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1a624f-1604-466c-b58a-ad1c85c175d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1a624f-1604-466c-b58a-ad1c85c175d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1734007790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be8de5d-a181-4e5d-8753-054a0c3d4989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619cd2379ab14bc5b33de5752bb1f007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3252b653-a4be-430f-8946-7098df932ce1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:15Z,use_quota=True,user_id='1d463b5bfed24ad185ed029dffeb7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3493949-57e0-4980-ab44-d58614b78c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3493949-57e0-4980-ab44-d58614b78c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdb481b-3157-4d01-b422-3cca03dbef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdb481b-3157-4d01-b422-3cca03dbef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8be8de5d-a181-4e5d-8753-054a0c3d4989', 'volume_name': 'volume-8be8de5d-a181-4e5d-8753-054a0c3d4989', 'volume_size': 1, 'snapshot_id': '3252b653-a4be-430f-8946-7098df932ce1'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8147a7f8-3101-47b5-bf68-aa126ee9b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8147a7f8-3101-47b5-bf68-aa126ee9b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5469eb27-ab34-4856-9ed0-ce7c00f41c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:14 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume 8be8de5d-a181-4e5d-8753-054a0c3d4989: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8be8de5d-a181-4e5d-8753-054a0c3d4989', 'volume_size': 1, 'snapshot_id': '3252b653-a4be-430f-8946-7098df932ce1'} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-3252b653-a4be-430f-8946-7098df932ce1-8be8de5d-a181-4e5d-8753-054a0c3d4989" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-3252b653-a4be-430f-8946-7098df932ce1-8be8de5d-a181-4e5d-8753-054a0c3d4989" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating volume 8be8de5d-a181-4e5d-8753-054a0c3d4989 from snapshot 3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-8be8de5d-a181-4e5d-8753-054a0c3d4989" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-8be8de5d-a181-4e5d-8753-054a0c3d4989" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] snapshot: 3252b653-a4be-430f-8946-7098df932ce1, volume: 8be8de5d-a181-4e5d-8753-054a0c3d4989, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec7e41-0cdc-4e87-af72-7c390c777c2e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:15 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 Sep 01 02:16:15 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:15 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1" returned: 0 in 0.370s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b521542-89fd-42de-a996-fc03751ae2a8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:15 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 Sep 01 02:16:15 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:15 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" returned: 0 in 0.386s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:16:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:15 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 Sep 01 02:16:15 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:20 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989" returned: 0 in 4.401s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:20 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Converted 1024.00 MB image at 232.57 MB/s Sep 01 02:16:20 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 is being set with open permissions: ugo+rw Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:20 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 Sep 01 02:16:20 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:20 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-8be8de5d-a181-4e5d-8753-054a0c3d4989" released by "_copy_volume_from_snapshot" :: held 5.506s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=77,cinder:INSERT=27,cinder:UPDATE=84,cinder:DELETE=5 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-3252b653-a4be-430f-8946-7098df932ce1-8be8de5d-a181-4e5d-8753-054a0c3d4989" released by "_create_volume_from_snapshot" :: held 5.590s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.608s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5469eb27-ab34-4856-9ed0-ce7c00f41c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be8de5d-a181-4e5d-8753-054a0c3d4989', 'volume_size': 1, 'snapshot_id': '3252b653-a4be-430f-8946-7098df932ce1'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59488218-91c0-4a63-921e-4fa93afffd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Volume volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 (8be8de5d-a181-4e5d-8753-054a0c3d4989): created successfully Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59488218-91c0-4a63-921e-4fa93afffd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Flow 'volume_create_manager' (60ad6e4d-c584-4331-a1e9-85399a94f31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:20 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-38c6adfd-98e1-4ecf-bea7-c4bad887dbd9 tempest-VolumesSnapshotTestJSON-2010914109 None] Created volume successfully. Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-8be8de5d-a181-4e5d-8753-054a0c3d4989-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-8be8de5d-a181-4e5d-8753-054a0c3d4989-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-8be8de5d-a181-4e5d-8753-054a0c3d4989" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-8be8de5d-a181-4e5d-8753-054a0c3d4989" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa0683-85ec-4cff-843d-7db61ea733dd]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 Sep 01 02:16:21 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989" returned: 0 in 0.372s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989 Sep 01 02:16:21 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8be8de5d-a181-4e5d-8753-054a0c3d4989" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-8be8de5d-a181-4e5d-8753-054a0c3d4989" released by "delete_volume" :: held 0.666s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['ceea6a27-43d1-4c7b-ba55-2077a89e6a2f', '8103301d-861c-4818-b8b4-1beffa1f22c0', '74e3249a-3126-4f14-951f-ce31eaf35f97', '09a59a94-e4d8-4bd3-a9c9-598e686e51a9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:16:22 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:22 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Deleted volume successfully. Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f16111a8-b38e-419c-b1cc-20315261a2e8 tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-8be8de5d-a181-4e5d-8753-054a0c3d4989-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-3252b653-a4be-430f-8946-7098df932ce1-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-3252b653-a4be-430f-8946-7098df932ce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-3252b653-a4be-430f-8946-7098df932ce1" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-3252b653-a4be-430f-8946-7098df932ce1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Deleting offline snapshot 3252b653-a4be-430f-8946-7098df932ce1 of volume 26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] snapshot_file for this snap is: volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb7f758-b45b-4cf3-8500-fcf1805c8978]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 Sep 01 02:16:22 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1" returned: 0 in 0.376s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfaff97-01d3-4840-899b-ac7bc64bece8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 Sep 01 02:16:23 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" returned: 0 in 0.554s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 Sep 01 02:16:23 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:24 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1" returned: 0 in 0.349s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:24 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1 Sep 01 02:16:24 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:24 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4.3252b653-a4be-430f-8946-7098df932ce1" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-3252b653-a4be-430f-8946-7098df932ce1" released by "_delete_snapshot" :: held 1.666s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" released by "delete_snapshot" :: held 1.692s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['1ce8ecde-9f20-4e93-8407-adf9275ae7e1', 'f15302a5-79b8-4263-9ba8-ed906b5d1e46', 'e0d833cb-e386-4495-a453-0f1728445d6f', '2a603088-b3cd-41e7-999d-e9ceb29b4066'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Delete snapshot completed successfully. Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14cc2508-8e13-4104-a147-5cb2c467d3ef tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-3252b653-a4be-430f-8946-7098df932ce1-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-26c9f334-9e4b-435b-a02c-2eb9d928f3b4-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-26c9f334-9e4b-435b-a02c-2eb9d928f3b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bb8ef6-281b-41eb-9962-617d682888c0]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 Sep 01 02:16:25 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" returned: 0 in 0.398s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4 Sep 01 02:16:25 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" returned: 0 in 0.253s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-26c9f334-9e4b-435b-a02c-2eb9d928f3b4" released by "delete_volume" :: held 0.707s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['1291fd97-d56a-470e-b654-365d5c283ec0', '7d4192d1-3a4d-44bc-9eed-ce5686d72dad', '545789f4-2345-4313-a1fd-c82a5cb6d334', 'd9ae04ac-9c49-43fb-9a1e-973e1c6303c3'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:16:25 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:26 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Deleted volume successfully. Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-a59473fb-3917-48c4-b406-2b128141438f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ac8258ad-6b0b-42f7-b683-79c7fc97523c tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-26c9f334-9e4b-435b-a02c-2eb9d928f3b4-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-a59473fb-3917-48c4-b406-2b128141438f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "cinder-quobyte-a59473fb-3917-48c4-b406-2b128141438f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-a59473fb-3917-48c4-b406-2b128141438f" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa3a0c-bd29-4d90-bf83-d77509048f5b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:26 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f Sep 01 02:16:26 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:26 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f" returned: 0 in 0.349s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:26 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f Sep 01 02:16:26 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:26 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a59473fb-3917-48c4-b406-2b128141438f" returned: 0 in 0.266s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-quobyte-a59473fb-3917-48c4-b406-2b128141438f" released by "delete_volume" :: held 0.663s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Created reservations ['08ca86ed-2a5f-40b8-9426-e8465b27e7c3', 'fa2c7f49-1755-4d9a-bd96-330cc2c3b409', 'cab8dd25-cf79-465f-a9d5-d79a6aa2d642', 'b81e5e17-4f89-47cd-aa7d-0865328cd356'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:27 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:16:27 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:27 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.240s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:27 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Deleted volume successfully. Sep 01 02:16:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-ddadc890-410c-4788-a7e5-804e369ae80f tempest-VolumesSnapshotTestJSON-2010914109 None] Lock "cinder-a59473fb-3917-48c4-b406-2b128141438f-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:28 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:16:28 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:28 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.257s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:16:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:16:36 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=77,cinder:UPDATE=75,cinder:DELETE=7,cinder:INSERT=20 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:37 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Flow 'volume_create_manager' (2a5d94af-218b-4318-a803-792eac60a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e054ff9-c15e-4e3b-b10c-8d7b6b1dc6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e054ff9-c15e-4e3b-b10c-8d7b6b1dc6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1554530708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8442fe19-3f7a-4903-b598-8158078b711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad00dc5ff03941e2aa07a12055228de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:05Z,use_quota=True,user_id='d0aeace08555451fa5748c8b4114c990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127ea3ca-2227-456c-af77-4e09fb96de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127ea3ca-2227-456c-af77-4e09fb96de8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd80714b-844e-43b9-9713-713bafd683d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd80714b-844e-43b9-9713-713bafd683d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8442fe19-3f7a-4903-b598-8158078b711b', 'volume_name': 'volume-8442fe19-3f7a-4903-b598-8158078b711b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b81531-e99a-4e11-8519-8dfdfc76074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b81531-e99a-4e11-8519-8dfdfc76074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8a104-22d6-4ecb-9269-3d02ba8643fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:05 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Volume 8442fe19-3f7a-4903-b598-8158078b711b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8442fe19-3f7a-4903-b598-8158078b711b', 'volume_size': 1} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1554530708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8442fe19-3f7a-4903-b598-8158078b711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad00dc5ff03941e2aa07a12055228de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:05Z,use_quota=True,user_id='d0aeace08555451fa5748c8b4114c990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Creating volume 8442fe19-3f7a-4903-b598-8158078b711b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:05 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b 1073741824 Sep 01 02:17:05 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:05 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b 1073741824" returned: 0 in 0.463s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b Sep 01 02:17:05 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b" returned: 0 in 0.283s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8a104-22d6-4ecb-9269-3d02ba8643fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8442fe19-3f7a-4903-b598-8158078b711b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47ccfe4-914d-4745-93bf-ae787c547d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:06 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Volume volume-8442fe19-3f7a-4903-b598-8158078b711b (8442fe19-3f7a-4903-b598-8158078b711b): created successfully Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47ccfe4-914d-4745-93bf-ae787c547d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Flow 'volume_create_manager' (2a5d94af-218b-4318-a803-792eac60a27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8156e714-be51-48e2-9e9a-2d936aedf310 tempest-TestMinimumBasicScenario-570798772 None] Created volume successfully. Sep 01 02:17:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-61e761b0-9e4f-4d64-bbfc-a49b89230699 req-fafa4349-e330-444d-8b7a-1342be616b27 tempest-TestMinimumBasicScenario-570798772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-61e761b0-9e4f-4d64-bbfc-a49b89230699 req-fafa4349-e330-444d-8b7a-1342be616b27 tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-61e761b0-9e4f-4d64-bbfc-a49b89230699 req-fafa4349-e330-444d-8b7a-1342be616b27 tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-61e761b0-9e4f-4d64-bbfc-a49b89230699 req-fafa4349-e330-444d-8b7a-1342be616b27 tempest-TestMinimumBasicScenario-570798772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-8442fe19-3f7a-4903-b598-8158078b711b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03369f05-4158-4117-b1a6-67e00d42dd7c', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:17:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-61e761b0-9e4f-4d64-bbfc-a49b89230699 req-fafa4349-e330-444d-8b7a-1342be616b27 tempest-TestMinimumBasicScenario-570798772 None] attachment_update completed successfully. Sep 01 02:17:18 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:18 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:28 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:17:28 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:28 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.281s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:17:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:17:49 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:49 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-b4efad2f-902f-41cc-b0d8-654db1ba0905 req-31e612e7-0bd8-4051-8bc7-69a1f4769ab5 tempest-TestMinimumBasicScenario-570798772 None] Terminate volume connection completed successfully. Sep 01 02:17:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-b4efad2f-902f-41cc-b0d8-654db1ba0905 req-31e612e7-0bd8-4051-8bc7-69a1f4769ab5 tempest-TestMinimumBasicScenario-570798772 None] Deleting attachment 03369f05-4158-4117-b1a6-67e00d42dd7c. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Acquiring lock "cinder-8442fe19-3f7a-4903-b598-8158078b711b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Lock "cinder-8442fe19-3f7a-4903-b598-8158078b711b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Acquiring lock "cinder-quobyte-8442fe19-3f7a-4903-b598-8158078b711b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Lock "cinder-quobyte-8442fe19-3f7a-4903-b598-8158078b711b" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[565422ad-2670-4190-9172-c539ebc2ff24]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b Sep 01 02:17:54 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:54 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b" returned: 0 in 0.373s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b Sep 01 02:17:54 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:54 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8442fe19-3f7a-4903-b598-8158078b711b" returned: 0 in 0.250s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Lock "cinder-quobyte-8442fe19-3f7a-4903-b598-8158078b711b" released by "delete_volume" :: held 0.663s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Created reservations ['b664ddde-b748-4da8-baff-5ea8598e4514', 'd55b5127-1c81-4abe-9282-0ddce758e135', 'c50572a5-3c13-4470-abbb-f0df36854907', '48e37185-8ee8-4f2c-b77f-f6c28178db3f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:17:54 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.294s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Deleted volume successfully. Sep 01 02:17:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-22a959f2-4aec-48a9-8833-31384e8d58db tempest-TestMinimumBasicScenario-570798772 None] Lock "cinder-8442fe19-3f7a-4903-b598-8158078b711b-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:04 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:05 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Flow 'volume_create_manager' (89e737c2-d9a4-4735-bc25-e48d8b2f03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b6bd7f-cb3b-46cd-b6d6-52bbb2f5ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b6bd7f-cb3b-46cd-b6d6-52bbb2f5ea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1696298826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2f2266-ff4b-482f-adc5-358038494c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c858d59b9b49a7ac3cfa56d4cf9851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:28Z,use_quota=True,user_id='b5c83b4b7b9b42ff98588b570253ea2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8894130d-8656-4a8a-8be8-543698516b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8894130d-8656-4a8a-8be8-543698516b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d452b407-e6e9-47c2-b432-ada06e8cdec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d452b407-e6e9-47c2-b432-ada06e8cdec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2f2266-ff4b-482f-adc5-358038494c3c', 'volume_name': 'volume-5a2f2266-ff4b-482f-adc5-358038494c3c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836b2973-bfe5-487c-b17d-7b1709047f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836b2973-bfe5-487c-b17d-7b1709047f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa4b226-1be7-4c8a-ab91-427a9ef6448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Volume 5a2f2266-ff4b-482f-adc5-358038494c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2f2266-ff4b-482f-adc5-358038494c3c', 'volume_size': 1} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1696298826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2f2266-ff4b-482f-adc5-358038494c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c858d59b9b49a7ac3cfa56d4cf9851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:28Z,use_quota=True,user_id='b5c83b4b7b9b42ff98588b570253ea2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Creating volume 5a2f2266-ff4b-482f-adc5-358038494c3c {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:28 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c 1073741824 Sep 01 02:18:28 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:18:28 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:28 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Flow 'volume_create_manager' (ac64d5cb-b68e-4569-b258-1dd4d8ca7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b5400b-a3c5-4062-916b-319e5b2f7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b5400b-a3c5-4062-916b-319e5b2f7342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-828408096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3347fb-dc1a-4eca-b48b-3001a0602c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c858d59b9b49a7ac3cfa56d4cf9851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:29Z,use_quota=True,user_id='b5c83b4b7b9b42ff98588b570253ea2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43340638-9923-4c92-8a5c-b395994feb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43340638-9923-4c92-8a5c-b395994feb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b5e1fa-4576-4821-a96a-0d5bcbd4205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b5e1fa-4576-4821-a96a-0d5bcbd4205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3347fb-dc1a-4eca-b48b-3001a0602c81', 'volume_name': 'volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b19d3a-d4bc-4cfb-97fb-791630e0f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b19d3a-d4bc-4cfb-97fb-791630e0f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268898ac-f471-4f8f-8cd2-03354cf4782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:28 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Volume 6e3347fb-dc1a-4eca-b48b-3001a0602c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81', 'volume_size': 1} Sep 01 02:18:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c 1073741824" returned: 0 in 0.551s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c Sep 01 02:18:29 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:29 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-828408096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3347fb-dc1a-4eca-b48b-3001a0602c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c858d59b9b49a7ac3cfa56d4cf9851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:29Z,use_quota=True,user_id='b5c83b4b7b9b42ff98588b570253ea2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Creating volume 6e3347fb-dc1a-4eca-b48b-3001a0602c81 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:29 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa4b226-1be7-4c8a-ab91-427a9ef6448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2f2266-ff4b-482f-adc5-358038494c3c', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:29 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 1073741824 Sep 01 02:18:29 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74819e73-121f-4ed7-b7f2-323ae7245f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Volume volume-5a2f2266-ff4b-482f-adc5-358038494c3c (5a2f2266-ff4b-482f-adc5-358038494c3c): created successfully Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74819e73-121f-4ed7-b7f2-323ae7245f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Flow 'volume_create_manager' (89e737c2-d9a4-4735-bc25-e48d8b2f03b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dbeaa108-6c54-4896-a996-be2f03b369f1 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Created volume successfully. Sep 01 02:18:29 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 1073741824" returned: 0 in 0.439s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 Sep 01 02:18:29 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:30 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81" returned: 0 in 0.239s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268898ac-f471-4f8f-8cd2-03354cf4782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb54b8b-7bca-439b-857c-ccc13b91935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:30 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Volume volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 (6e3347fb-dc1a-4eca-b48b-3001a0602c81): created successfully Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb54b8b-7bca-439b-857c-ccc13b91935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Flow 'volume_create_manager' (ac64d5cb-b68e-4569-b258-1dd4d8ca7d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-29e8c1fc-3e5c-469c-b1e3-942a0de34290 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Created volume successfully. Sep 01 02:18:40 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=3,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:40 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8218b66f-99a6-4c51-bba8-e70400910b4f req-3c23f553-e330-4e6f-a351-0ac4c2d50ada tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8218b66f-99a6-4c51-bba8-e70400910b4f req-3c23f553-e330-4e6f-a351-0ac4c2d50ada tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-8218b66f-99a6-4c51-bba8-e70400910b4f req-3c23f553-e330-4e6f-a351-0ac4c2d50ada tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-8218b66f-99a6-4c51-bba8-e70400910b4f req-3c23f553-e330-4e6f-a351-0ac4c2d50ada tempest-TestServerVolumeAttachmentScenario-1134853290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-5a2f2266-ff4b-482f-adc5-358038494c3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29008580-32f5-43cf-8911-ff359aaecb48', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:19:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-8218b66f-99a6-4c51-bba8-e70400910b4f req-3c23f553-e330-4e6f-a351-0ac4c2d50ada tempest-TestServerVolumeAttachmentScenario-1134853290 None] attachment_update completed successfully. Sep 01 02:19:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-6c0a45e7-5482-4816-9c96-720944cc4907 req-9e002b4a-b52b-4ab9-9375-539a9169aa80 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-6c0a45e7-5482-4816-9c96-720944cc4907 req-9e002b4a-b52b-4ab9-9375-539a9169aa80 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [req-6c0a45e7-5482-4816-9c96-720944cc4907 req-9e002b4a-b52b-4ab9-9375-539a9169aa80 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:03 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-6c0a45e7-5482-4816-9c96-720944cc4907 req-9e002b4a-b52b-4ab9-9375-539a9169aa80 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825', 'name': 'volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ba4d977-16ee-450f-8825-2b6cae85e834', 'enforce_multipath': True} {{(pid=87404) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:19:03 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-6c0a45e7-5482-4816-9c96-720944cc4907 req-9e002b4a-b52b-4ab9-9375-539a9169aa80 tempest-TestServerVolumeAttachmentScenario-1134853290 None] attachment_update completed successfully. Sep 01 02:19:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-91d5ce0f-8554-4b40-9805-136ffe263061 req-17424492-0ec6-40be-aa0c-7d869cd84387 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Terminate volume connection completed successfully. Sep 01 02:19:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-91d5ce0f-8554-4b40-9805-136ffe263061 req-17424492-0ec6-40be-aa0c-7d869cd84387 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Deleting attachment 3ba4d977-16ee-450f-8825-2b6cae85e834. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [req-247f4e4c-eb75-4fce-aef6-d4e3e6fcad45 req-9824bf41-ea6f-41fd-a286-e731418d8e01 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Terminate volume connection completed successfully. Sep 01 02:19:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [req-247f4e4c-eb75-4fce-aef6-d4e3e6fcad45 req-9824bf41-ea6f-41fd-a286-e731418d8e01 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Deleting attachment 29008580-32f5-43cf-8911-ff359aaecb48. {{(pid=87404) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "cinder-6e3347fb-dc1a-4eca-b48b-3001a0602c81-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-6e3347fb-dc1a-4eca-b48b-3001a0602c81-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "cinder-quobyte-6e3347fb-dc1a-4eca-b48b-3001a0602c81" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-quobyte-6e3347fb-dc1a-4eca-b48b-3001a0602c81" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:11 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b6501-a958-4247-831f-0077c609c82b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:11 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 Sep 01 02:19:11 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:12 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81" returned: 0 in 0.359s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:12 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81 Sep 01 02:19:12 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:12 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6e3347fb-dc1a-4eca-b48b-3001a0602c81" returned: 0 in 0.251s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-quobyte-6e3347fb-dc1a-4eca-b48b-3001a0602c81" released by "delete_volume" :: held 0.648s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Created reservations ['dcb3c153-e88b-434e-a359-9d9f1143a79a', '5fbaa87a-34f8-47c4-b11a-c7e7c63cb62e', 'f6dfb588-ab88-4a32-8055-1aa70ba71bf9', '90cd60f3-d973-49d6-ba63-987e9ad32588'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:12 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:12 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:12 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Deleted volume successfully. Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-19d77e78-ba74-4975-bff6-fd3de986b1cd tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-6e3347fb-dc1a-4eca-b48b-3001a0602c81-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "cinder-5a2f2266-ff4b-482f-adc5-358038494c3c-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-5a2f2266-ff4b-482f-adc5-358038494c3c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "cinder-quobyte-5a2f2266-ff4b-482f-adc5-358038494c3c" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-quobyte-5a2f2266-ff4b-482f-adc5-358038494c3c" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589dc2f-2881-488b-93c3-9440fcd35e9f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:12 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c Sep 01 02:19:12 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c" returned: 0 in 0.364s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c Sep 01 02:19:13 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5a2f2266-ff4b-482f-adc5-358038494c3c" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-quobyte-5a2f2266-ff4b-482f-adc5-358038494c3c" released by "delete_volume" :: held 0.652s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Created reservations ['325632ee-418e-49cc-94b7-bc0d68ddedac', '1eda4d6c-e5d1-4cf7-9efe-3cb5dac6b9e3', 'af7b6ea7-f4dd-44e0-9a22-ebf171a826b3', 'bb269af1-5117-4d38-abda-bee502c1ae7f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:13 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.257s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:13 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Deleted volume successfully. Sep 01 02:19:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f7da5b3-6a2a-4dd3-b461-9a6a5d0ab329 tempest-TestServerVolumeAttachmentScenario-1134853290 None] Lock "cinder-5a2f2266-ff4b-482f-adc5-358038494c3c-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:23 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:23 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=27,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Flow 'volume_create_manager' (990ad15e-3141-47da-b71d-15b74aa3dc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498f35d5-2235-45a9-9290-97c947bb10f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498f35d5-2235-45a9-9290-97c947bb10f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1860306991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88f2984-7428-469a-9309-56f2e25fdc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c85bc7df004338867bcbad99cdf739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:26Z,use_quota=True,user_id='b23a4577b834406bb9cff7137dfca379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38437add-dd00-4f8f-9549-725bfeefafad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38437add-dd00-4f8f-9549-725bfeefafad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629a26ec-9cd3-41f4-a8f8-591e93f2e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629a26ec-9cd3-41f4-a8f8-591e93f2e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88f2984-7428-469a-9309-56f2e25fdc31', 'volume_name': 'volume-c88f2984-7428-469a-9309-56f2e25fdc31', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2789248-b90c-4164-969e-b143f5f0af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2789248-b90c-4164-969e-b143f5f0af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c330d89-7d7b-413d-96dc-1e5d3ed92cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:25 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Volume c88f2984-7428-469a-9309-56f2e25fdc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88f2984-7428-469a-9309-56f2e25fdc31', 'volume_size': 1} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1860306991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88f2984-7428-469a-9309-56f2e25fdc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c85bc7df004338867bcbad99cdf739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:26Z,use_quota=True,user_id='b23a4577b834406bb9cff7137dfca379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Creating volume c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:25 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:19:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 1073741824 Sep 01 02:19:25 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 1073741824" returned: 0 in 0.405s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:26 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 Sep 01 02:19:26 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c330d89-7d7b-413d-96dc-1e5d3ed92cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88f2984-7428-469a-9309-56f2e25fdc31', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e17a7ef-3fe1-425b-9b6d-0374367d974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Volume volume-c88f2984-7428-469a-9309-56f2e25fdc31 (c88f2984-7428-469a-9309-56f2e25fdc31): created successfully Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e17a7ef-3fe1-425b-9b6d-0374367d974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Flow 'volume_create_manager' (990ad15e-3141-47da-b71d-15b74aa3dc93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ac7fdca5-3bb2-4008-ab74-4f38f3e75be7 tempest-VolumeDependencyTests-1069774122 None] Created volume successfully. Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Creating offline snapshot f39fde5b-9854-4dae-ae91-9027f847c4c1 of volume c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9cb11-84a1-469f-930f-ccc858e6561e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:27 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 Sep 01 02:19:27 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:27 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31" returned: 0 in 0.355s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:27 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 1G Sep 01 02:19:27 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:27 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 1G" returned: 0 in 0.390s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c88f2984-7428-469a-9309-56f2e25fdc31 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:27 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c88f2984-7428-469a-9309-56f2e25fdc31 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 Sep 01 02:19:27 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c88f2984-7428-469a-9309-56f2e25fdc31 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1" returned: 0 in 0.300s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 is being set with open permissions: ugo+rw Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 Sep 01 02:19:28 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1" returned: 0 in 0.236s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info Sep 01 02:19:28 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:28 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info is being set with open permissions: ugo+rw Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:28 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:28 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info Sep 01 02:19:28 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:28 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.info" returned: 0 in 0.244s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.276s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:19:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:19:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b06e1dc9-85b7-4a88-a499-d43f84e0942b tempest-VolumeDependencyTests-1069774122 None] Create snapshot completed successfully Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Flow 'volume_create_manager' (c7cd5bce-a4b7-43ae-b5dc-d4f074a1f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb371b73-30e6-4361-9ca8-d49537b4d342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb371b73-30e6-4361-9ca8-d49537b4d342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1490671730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdc3950-4030-4d23-90cd-6c287e4041e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c85bc7df004338867bcbad99cdf739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f39fde5b-9854-4dae-ae91-9027f847c4c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:30Z,use_quota=True,user_id='b23a4577b834406bb9cff7137dfca379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1dd34c-1068-4417-9f66-2b3318a5b461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1dd34c-1068-4417-9f66-2b3318a5b461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e31c4f2-34e7-4e62-ad49-0d8adff66f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e31c4f2-34e7-4e62-ad49-0d8adff66f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cdc3950-4030-4d23-90cd-6c287e4041e7', 'volume_name': 'volume-0cdc3950-4030-4d23-90cd-6c287e4041e7', 'volume_size': 1, 'snapshot_id': 'f39fde5b-9854-4dae-ae91-9027f847c4c1'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f972485-626a-4b79-aa2f-fa90ecdcf780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f972485-626a-4b79-aa2f-fa90ecdcf780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d427d97-bc74-4938-a96b-9eeabae8a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Volume 0cdc3950-4030-4d23-90cd-6c287e4041e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cdc3950-4030-4d23-90cd-6c287e4041e7', 'volume_size': 1, 'snapshot_id': 'f39fde5b-9854-4dae-ae91-9027f847c4c1'} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-quobyte-f39fde5b-9854-4dae-ae91-9027f847c4c1-0cdc3950-4030-4d23-90cd-6c287e4041e7" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-f39fde5b-9854-4dae-ae91-9027f847c4c1-0cdc3950-4030-4d23-90cd-6c287e4041e7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Creating volume 0cdc3950-4030-4d23-90cd-6c287e4041e7 from snapshot f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-quobyte-0cdc3950-4030-4d23-90cd-6c287e4041e7" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-0cdc3950-4030-4d23-90cd-6c287e4041e7" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] snapshot: f39fde5b-9854-4dae-ae91-9027f847c4c1, volume: 0cdc3950-4030-4d23-90cd-6c287e4041e7, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb2092-5890-47a3-898c-53bfc236bce7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:29 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 Sep 01 02:19:29 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:30 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1" returned: 0 in 0.388s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c88f2984-7428-469a-9309-56f2e25fdc31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b43c63-38f1-4287-941b-7e924d211339]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:30 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 Sep 01 02:19:30 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:30 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31" returned: 0 in 0.358s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:19:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:30 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 Sep 01 02:19:30 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7" returned: 0 in 4.087s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:19:34 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Converted 1024.00 MB image at 250.46 MB/s Sep 01 02:19:34 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 is being set with open permissions: ugo+rw Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:34 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 Sep 01 02:19:34 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:34 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7" returned: 0 in 0.238s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-0cdc3950-4030-4d23-90cd-6c287e4041e7" released by "_copy_volume_from_snapshot" :: held 5.147s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-f39fde5b-9854-4dae-ae91-9027f847c4c1-0cdc3950-4030-4d23-90cd-6c287e4041e7" released by "_create_volume_from_snapshot" :: held 5.214s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.228s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d427d97-bc74-4938-a96b-9eeabae8a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdc3950-4030-4d23-90cd-6c287e4041e7', 'volume_size': 1, 'snapshot_id': 'f39fde5b-9854-4dae-ae91-9027f847c4c1'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ded24cf-e179-49a8-8481-c05d05f54630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Volume volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 (0cdc3950-4030-4d23-90cd-6c287e4041e7): created successfully Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ded24cf-e179-49a8-8481-c05d05f54630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Flow 'volume_create_manager' (c7cd5bce-a4b7-43ae-b5dc-d4f074a1f361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9b6bd0d1-0639-49bf-90e7-d1bbb6137ebb tempest-VolumeDependencyTests-1069774122 None] Created volume successfully. Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-f39fde5b-9854-4dae-ae91-9027f847c4c1-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-f39fde5b-9854-4dae-ae91-9027f847c4c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-quobyte-c88f2984-7428-469a-9309-56f2e25fdc31" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-c88f2984-7428-469a-9309-56f2e25fdc31" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-quobyte-f39fde5b-9854-4dae-ae91-9027f847c4c1" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-f39fde5b-9854-4dae-ae91-9027f847c4c1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Deleting offline snapshot f39fde5b-9854-4dae-ae91-9027f847c4c1 of volume c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] snapshot_file for this snap is: volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[60802bca-e1d3-4866-9e69-2ff3be6e3e9e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:35 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 Sep 01 02:19:35 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:35 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1" returned: 0 in 0.384s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c88f2984-7428-469a-9309-56f2e25fdc31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fb6b0d-2464-4503-b39a-5f650af26a68]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:35 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 Sep 01 02:19:35 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:36 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31" returned: 0 in 0.537s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:36 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 Sep 01 02:19:36 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:36 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1" returned: 0 in 0.318s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:36 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1 Sep 01 02:19:36 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:36 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31.f39fde5b-9854-4dae-ae91-9027f847c4c1" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-f39fde5b-9854-4dae-ae91-9027f847c4c1" released by "_delete_snapshot" :: held 1.578s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-c88f2984-7428-469a-9309-56f2e25fdc31" released by "delete_snapshot" :: held 1.610s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Created reservations ['08fe806b-1545-48d4-aa4f-4fcc609fc522', '8d1b7844-312c-4f5d-82ed-5d29fe6a9349', '4a70a8cc-3df0-4bbc-9246-bbf05be6a75a', 'f52fd332-2c7f-4085-9a7e-9059d159c2fc'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Delete snapshot completed successfully. Sep 01 02:19:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-75b2c636-78d8-4f45-b2e5-2905671b909f tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-f39fde5b-9854-4dae-ae91-9027f847c4c1-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-c88f2984-7428-469a-9309-56f2e25fdc31-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-c88f2984-7428-469a-9309-56f2e25fdc31-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-quobyte-c88f2984-7428-469a-9309-56f2e25fdc31" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-c88f2984-7428-469a-9309-56f2e25fdc31" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01b952-d181-4ff2-b409-c43b37f4ee94]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:37 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 Sep 01 02:19:37 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:37 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31" returned: 0 in 0.354s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:37 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31 Sep 01 02:19:37 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:38 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-c88f2984-7428-469a-9309-56f2e25fdc31" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-c88f2984-7428-469a-9309-56f2e25fdc31" released by "delete_volume" :: held 0.655s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Created reservations ['8170b634-39b0-4b73-8a4f-2ac45c5a9433', 'd166a395-f967-4833-b6eb-e69c52ab5311', '2ede1dbe-ba5b-47af-a1c8-d63c1aa70710', '4e3bb7ac-6975-4869-832b-e6ce38944d53'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:38 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:38 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:38 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.242s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Deleted volume successfully. Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6d571812-56c0-4d18-9755-84ad4ea88197 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-c88f2984-7428-469a-9309-56f2e25fdc31-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-0cdc3950-4030-4d23-90cd-6c287e4041e7-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-0cdc3950-4030-4d23-90cd-6c287e4041e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "cinder-quobyte-0cdc3950-4030-4d23-90cd-6c287e4041e7" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-0cdc3950-4030-4d23-90cd-6c287e4041e7" acquired by "delete_volume" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[38114b77-8f40-47c9-8e12-8740a21ff46d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:38 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 Sep 01 02:19:38 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:38 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7" returned: 0 in 0.387s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:39 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7 Sep 01 02:19:39 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:39 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-0cdc3950-4030-4d23-90cd-6c287e4041e7" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-quobyte-0cdc3950-4030-4d23-90cd-6c287e4041e7" released by "delete_volume" :: held 0.706s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Created reservations ['840730ff-f784-40a8-b5a8-6fa0d4392a3b', '60eeadb9-a6d1-4a5c-84e1-79099613f446', 'ab81e064-b592-4b8f-8684-be17e1e894d5', 'f66e9758-a762-412d-afd5-ba8132f0bc8d'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:39 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:39 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:39 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Deleted volume successfully. Sep 01 02:19:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-14324ce6-afec-49d9-a893-269dd42ea432 tempest-VolumeDependencyTests-1069774122 None] Lock "cinder-0cdc3950-4030-4d23-90cd-6c287e4041e7-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Flow 'volume_create_manager' (35bece00-9c21-4557-ad46-3a743a3960bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa493a36-e2bf-4125-8262-cb44811813a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa493a36-e2bf-4125-8262-cb44811813a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61936999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad65af3-f765-46c0-a78f-1e3cce94f3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055ce800a0b2451088f4c5c75e45a0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:43Z,use_quota=True,user_id='e2c99a2971e64c5c8493a11be7b5e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfe9643-eb1b-4e23-b657-9f18276b6788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfe9643-eb1b-4e23-b657-9f18276b6788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea39ec7-f4b7-43f5-acbb-4c73317e00ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea39ec7-f4b7-43f5-acbb-4c73317e00ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad65af3-f765-46c0-a78f-1e3cce94f3db', 'volume_name': 'volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48d2b0b-92ef-4021-9703-ea16cbcc6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48d2b0b-92ef-4021-9703-ea16cbcc6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6daa66-e4a6-4970-96b8-e57b9688d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:43 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Volume 3ad65af3-f765-46c0-a78f-1e3cce94f3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db', 'volume_size': 1} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61936999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad65af3-f765-46c0-a78f-1e3cce94f3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055ce800a0b2451088f4c5c75e45a0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:43Z,use_quota=True,user_id='e2c99a2971e64c5c8493a11be7b5e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Creating volume 3ad65af3-f765-46c0-a78f-1e3cce94f3db {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:43 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:43 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db 1073741824 Sep 01 02:19:43 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:43 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db 1073741824" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:43 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db Sep 01 02:19:43 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:44 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6daa66-e4a6-4970-96b8-e57b9688d497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbcc3e5-62b0-4a51-ba03-bb7433539c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:44 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Volume volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db (3ad65af3-f765-46c0-a78f-1e3cce94f3db): created successfully Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbcc3e5-62b0-4a51-ba03-bb7433539c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Flow 'volume_create_manager' (35bece00-9c21-4557-ad46-3a743a3960bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5b09d739-995d-42cb-bed5-a7fa93e93314 tempest-ProjectReaderTests-1554718947 None] Created volume successfully. Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Acquiring lock "cinder-3ad65af3-f765-46c0-a78f-1e3cce94f3db-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Lock "cinder-3ad65af3-f765-46c0-a78f-1e3cce94f3db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Acquiring lock "cinder-quobyte-3ad65af3-f765-46c0-a78f-1e3cce94f3db" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Lock "cinder-quobyte-3ad65af3-f765-46c0-a78f-1e3cce94f3db" acquired by "delete_volume" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[11636a22-771a-4cdc-a4c9-263739c2f3a8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:44 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db Sep 01 02:19:44 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:44 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db" returned: 0 in 0.332s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:44 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db Sep 01 02:19:44 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:45 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-3ad65af3-f765-46c0-a78f-1e3cce94f3db" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Lock "cinder-quobyte-3ad65af3-f765-46c0-a78f-1e3cce94f3db" released by "delete_volume" :: held 0.637s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Created reservations ['09df8c15-181b-4bfe-9628-b71166034df8', '0d24f441-2d2c-4ddd-bea5-15a56396953f', '201b8b94-07aa-4e48-a084-e3ca73981b8e', 'd0da2500-e828-4097-8c3f-be82f2b520a4'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:45 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:45 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:45 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Deleted volume successfully. Sep 01 02:19:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b8020ca8-d238-4db9-83c4-1590ef12164e tempest-ProjectReaderTests-1554718947 None] Lock "cinder-3ad65af3-f765-46c0-a78f-1e3cce94f3db-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Flow 'volume_create_manager' (c804bfb3-fcfb-49bb-9d57-02e232342211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198a7556-8ded-40e2-ad14-16cd80fc932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198a7556-8ded-40e2-ad14-16cd80fc932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441795081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea8b9f2-b88e-4690-b308-3685bfa8f523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055ce800a0b2451088f4c5c75e45a0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:46Z,use_quota=True,user_id='e2c99a2971e64c5c8493a11be7b5e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea641d4-8396-4302-9f32-6ed8feab44de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea641d4-8396-4302-9f32-6ed8feab44de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297b9ee3-1213-42f6-8ad2-36a519bf2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297b9ee3-1213-42f6-8ad2-36a519bf2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea8b9f2-b88e-4690-b308-3685bfa8f523', 'volume_name': 'volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a14b3f4-5b56-4105-a762-63c023a84d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a14b3f4-5b56-4105-a762-63c023a84d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6904ab-7074-4ccc-b9a4-e87924d6a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:46 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Volume 5ea8b9f2-b88e-4690-b308-3685bfa8f523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523', 'volume_size': 1} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441795081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea8b9f2-b88e-4690-b308-3685bfa8f523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055ce800a0b2451088f4c5c75e45a0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:46Z,use_quota=True,user_id='e2c99a2971e64c5c8493a11be7b5e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Creating volume 5ea8b9f2-b88e-4690-b308-3685bfa8f523 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:46 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:46 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 1073741824 Sep 01 02:19:46 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:46 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 1073741824" returned: 0 in 0.383s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:46 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 Sep 01 02:19:46 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:46 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523" returned: 0 in 0.227s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6904ab-7074-4ccc-b9a4-e87924d6a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9ded83-5617-4fb6-9740-6adc472d1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:46 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Volume volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 (5ea8b9f2-b88e-4690-b308-3685bfa8f523): created successfully Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9ded83-5617-4fb6-9740-6adc472d1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Flow 'volume_create_manager' (c804bfb3-fcfb-49bb-9d57-02e232342211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-024f0bb4-fcb3-411a-be9f-a15f15310cd2 tempest-ProjectReaderTests-1554718947 None] Created volume successfully. Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "cinder-5ea8b9f2-b88e-4690-b308-3685bfa8f523-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Lock "cinder-5ea8b9f2-b88e-4690-b308-3685bfa8f523-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "cinder-quobyte-5ea8b9f2-b88e-4690-b308-3685bfa8f523" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Lock "cinder-quobyte-5ea8b9f2-b88e-4690-b308-3685bfa8f523" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c4fe7d-4d13-4078-8c94-aee50dc32a20]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:47 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 Sep 01 02:19:47 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:47 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523" returned: 0 in 0.381s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:47 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523 Sep 01 02:19:47 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:47 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5ea8b9f2-b88e-4690-b308-3685bfa8f523" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Lock "cinder-quobyte-5ea8b9f2-b88e-4690-b308-3685bfa8f523" released by "delete_volume" :: held 0.663s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Created reservations ['f55f3fe8-8d63-4641-8e33-7fd700a48ae8', 'd705d4a8-f634-4824-8327-0db14abd79a0', '4d92aa57-07be-4993-a889-0c7bea6534f2', '451fa381-2004-4c11-af6e-1ecbd7300432'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:47 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:47 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:48 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:48 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Deleted volume successfully. Sep 01 02:19:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6813a9ee-2d0f-4272-bef5-5178fdfef886 tempest-ProjectReaderTests-1554718947 None] Lock "cinder-5ea8b9f2-b88e-4690-b308-3685bfa8f523-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (9afa916a-0537-4d9a-ab56-5f4c4244386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205be4ce-db0b-4b02-8b82-122e7e14b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205be4ce-db0b-4b02-8b82-122e7e14b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339666587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f3577a-28e2-45ef-97b5-6a648d832dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:52Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c70053-dcee-4f56-9880-91b0959c5351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c70053-dcee-4f56-9880-91b0959c5351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bdb5c6-95e4-4af4-bfa4-ef5d5b30feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bdb5c6-95e4-4af4-bfa4-ef5d5b30feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f3577a-28e2-45ef-97b5-6a648d832dcf', 'volume_name': 'volume-01f3577a-28e2-45ef-97b5-6a648d832dcf', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c79ff0-445e-4a52-ac02-450df25a2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c79ff0-445e-4a52-ac02-450df25a2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0680720-fd1a-4da9-8313-4e1558e306d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:51 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Volume 01f3577a-28e2-45ef-97b5-6a648d832dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f3577a-28e2-45ef-97b5-6a648d832dcf', 'volume_size': 1} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339666587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f3577a-28e2-45ef-97b5-6a648d832dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:52Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Creating volume 01f3577a-28e2-45ef-97b5-6a648d832dcf {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:51 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:19:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:51 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf 1073741824 Sep 01 02:19:51 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:52 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf 1073741824" returned: 0 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:52 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf Sep 01 02:19:52 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:52 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf" returned: 0 in 0.240s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0680720-fd1a-4da9-8313-4e1558e306d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f3577a-28e2-45ef-97b5-6a648d832dcf', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dae8982-0d4f-41de-a30d-583c617e33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:52 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Volume volume-01f3577a-28e2-45ef-97b5-6a648d832dcf (01f3577a-28e2-45ef-97b5-6a648d832dcf): created successfully Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dae8982-0d4f-41de-a30d-583c617e33ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:52 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (9afa916a-0537-4d9a-ab56-5f4c4244386d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-34f5b8b0-e4b4-4e83-bc67-ce56dec6a679 tempest-ProjectReaderTests-889981266 None] Created volume successfully. Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-01f3577a-28e2-45ef-97b5-6a648d832dcf-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Lock "cinder-01f3577a-28e2-45ef-97b5-6a648d832dcf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-quobyte-01f3577a-28e2-45ef-97b5-6a648d832dcf" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-01f3577a-28e2-45ef-97b5-6a648d832dcf" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3d975a-8792-43d2-b331-7c217a75c14c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:53 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf Sep 01 02:19:53 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:53 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf" returned: 0 in 0.349s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:53 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf Sep 01 02:19:53 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:53 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-01f3577a-28e2-45ef-97b5-6a648d832dcf" returned: 0 in 0.230s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-01f3577a-28e2-45ef-97b5-6a648d832dcf" released by "delete_volume" :: held 0.617s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Created reservations ['9f0d5b86-6700-4fd1-8dd7-e557be35649d', 'c8afdae1-2dae-4f71-9689-d984ff20680e', '93a18853-024b-42b1-812d-8843ff03f3ad', '24a385b3-c7b8-4a08-876e-5c30ed043991'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:53 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:53 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:54 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Deleted volume successfully. Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-90569db8-367e-4113-b6e2-7d0b2b6f1824 tempest-ProjectReaderTests-889981266 None] Lock "cinder-01f3577a-28e2-45ef-97b5-6a648d832dcf-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (335d64c5-6d88-42f4-a786-f12302e2776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6216c575-686d-4699-8873-50a39b86e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6216c575-686d-4699-8873-50a39b86e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31006879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740ea5c9-4c58-42d7-b075-18bf21b56bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:55Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5042f0c5-6057-40c5-b94f-bc014377cfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5042f0c5-6057-40c5-b94f-bc014377cfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0137c92-189e-43ed-b4b7-1e9e672e0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0137c92-189e-43ed-b4b7-1e9e672e0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740ea5c9-4c58-42d7-b075-18bf21b56bd1', 'volume_name': 'volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c38deaf-80ff-4dd3-b54f-c146d5cde091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c38deaf-80ff-4dd3-b54f-c146d5cde091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07efda6-533a-4d24-a7d2-8ab72d7b8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Volume 740ea5c9-4c58-42d7-b075-18bf21b56bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1', 'volume_size': 1} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31006879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740ea5c9-4c58-42d7-b075-18bf21b56bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:55Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Creating volume 740ea5c9-4c58-42d7-b075-18bf21b56bd1 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:54 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:19:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:54 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 1073741824 Sep 01 02:19:54 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:55 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 1073741824" returned: 0 in 0.411s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:55 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 Sep 01 02:19:55 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:55 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1" returned: 0 in 0.236s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07efda6-533a-4d24-a7d2-8ab72d7b8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617f9008-7931-4907-b181-dda3c7d8503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Volume volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 (740ea5c9-4c58-42d7-b075-18bf21b56bd1): created successfully Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617f9008-7931-4907-b181-dda3c7d8503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (335d64c5-6d88-42f4-a786-f12302e2776b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b084d892-96b1-4813-a9ce-f226cd49a105 tempest-ProjectReaderTests-889981266 None] Created volume successfully. Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-740ea5c9-4c58-42d7-b075-18bf21b56bd1-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Lock "cinder-740ea5c9-4c58-42d7-b075-18bf21b56bd1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-quobyte-740ea5c9-4c58-42d7-b075-18bf21b56bd1" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-740ea5c9-4c58-42d7-b075-18bf21b56bd1" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ead53-0689-48d4-85c5-2cfc03565df9]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:55 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 Sep 01 02:19:55 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:56 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:56 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1 Sep 01 02:19:56 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:56 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-740ea5c9-4c58-42d7-b075-18bf21b56bd1" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-740ea5c9-4c58-42d7-b075-18bf21b56bd1" released by "delete_volume" :: held 0.640s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Created reservations ['e63d0cbb-d829-4a38-a29e-a164a2140a9c', '59b36d23-c4d9-4a6f-a431-4285321e4b56', 'b4ae7bbd-bf85-4f69-ab17-4c9a3df7d5dc', '5faacf44-90af-4c7d-a2e2-a71839e83284'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:56 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:56 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:56 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.250s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Deleted volume successfully. Sep 01 02:19:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a93defdc-07f5-4ae0-9fc1-adfc6dea7855 tempest-ProjectReaderTests-889981266 None] Lock "cinder-740ea5c9-4c58-42d7-b075-18bf21b56bd1-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (275cba27-1cdf-457d-bba7-ccd44af98875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f71f06-0d4a-438d-8d87-cf11f5066ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f71f06-0d4a-438d-8d87-cf11f5066ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50614232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9724f55a-f61d-428f-8488-6c7bfbe9a82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:57Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11928eb2-ce0d-4c85-9c7d-441ccd2b8b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11928eb2-ce0d-4c85-9c7d-441ccd2b8b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c45027-468f-4dab-a4f4-49a2a34f801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c45027-468f-4dab-a4f4-49a2a34f801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9724f55a-f61d-428f-8488-6c7bfbe9a82f', 'volume_name': 'volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b44a14-f4a2-48ad-87cf-0aac743976fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b44a14-f4a2-48ad-87cf-0aac743976fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91416cc-bef7-40a8-8acc-269193318d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Volume 9724f55a-f61d-428f-8488-6c7bfbe9a82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f', 'volume_size': 1} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50614232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9724f55a-f61d-428f-8488-6c7bfbe9a82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:57Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Creating volume 9724f55a-f61d-428f-8488-6c7bfbe9a82f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:57 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:57 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f 1073741824 Sep 01 02:19:57 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:57 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f 1073741824" returned: 0 in 0.411s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:57 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f Sep 01 02:19:57 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f" returned: 0 in 0.241s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91416cc-bef7-40a8-8acc-269193318d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275d6cf9-7508-4f2a-9575-31d06ad7a348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:58 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Volume volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f (9724f55a-f61d-428f-8488-6c7bfbe9a82f): created successfully Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275d6cf9-7508-4f2a-9575-31d06ad7a348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (275cba27-1cdf-457d-bba7-ccd44af98875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ffef5a04-aaa8-4392-8158-a65fd06dca11 tempest-ProjectReaderTests-889981266 None] Created volume successfully. Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-9724f55a-f61d-428f-8488-6c7bfbe9a82f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-9724f55a-f61d-428f-8488-6c7bfbe9a82f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-quobyte-9724f55a-f61d-428f-8488-6c7bfbe9a82f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-9724f55a-f61d-428f-8488-6c7bfbe9a82f" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a30bd0c-d750-4267-b781-5a9aabc72c13]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:58 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f Sep 01 02:19:58 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f" returned: 0 in 0.360s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:58 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f Sep 01 02:19:58 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:59 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-9724f55a-f61d-428f-8488-6c7bfbe9a82f" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-9724f55a-f61d-428f-8488-6c7bfbe9a82f" released by "delete_volume" :: held 0.671s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Created reservations ['12afd6cb-579a-43e1-95a8-2c12bde503f3', 'f777a51f-3aee-4211-81bc-eb2d65278414', '7d396e23-6fda-4c8c-b29a-125a92fa5ae5', 'b50b50cd-80ff-4c53-80ea-8c2755e2d2d1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:59 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:19:59 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:59 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.258s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Deleted volume successfully. Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-30bc8f7b-1a4c-4d35-87b4-8c12e22c5ad0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-9724f55a-f61d-428f-8488-6c7bfbe9a82f-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:59 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (970a23cc-40af-4774-9cd4-68231ef6eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf2b1af-8b6a-4231-81d3-2fc16a5c1611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf2b1af-8b6a-4231-81d3-2fc16a5c1611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702153472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b76852-e6f1-4332-98a5-6b4e99e6b6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:00Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99411890-4430-4b32-9c12-3587267feab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99411890-4430-4b32-9c12-3587267feab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bdca9c-58fb-4f0d-ba3c-00685dba0445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bdca9c-58fb-4f0d-ba3c-00685dba0445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b76852-e6f1-4332-98a5-6b4e99e6b6d2', 'volume_name': 'volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0e0689-4f42-4e5d-b5fe-3e11ae907e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0e0689-4f42-4e5d-b5fe-3e11ae907e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0773088-d790-4b95-a96e-ffb0d3ae0f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Volume 72b76852-e6f1-4332-98a5-6b4e99e6b6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2', 'volume_size': 1} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702153472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b76852-e6f1-4332-98a5-6b4e99e6b6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4cb3a36ac249c3ab2f6022b5f8e314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:00Z,use_quota=True,user_id='b96f72f4634046eb8e10fa7745b47d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Creating volume 72b76852-e6f1-4332-98a5-6b4e99e6b6d2 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:00 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:00 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 1073741824 Sep 01 02:20:00 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:00 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 1073741824" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:00 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 Sep 01 02:20:00 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:00 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2" returned: 0 in 0.276s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0773088-d790-4b95-a96e-ffb0d3ae0f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5b2860-a1f1-4012-bb37-25cfc2216545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Volume volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 (72b76852-e6f1-4332-98a5-6b4e99e6b6d2): created successfully Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5b2860-a1f1-4012-bb37-25cfc2216545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Flow 'volume_create_manager' (970a23cc-40af-4774-9cd4-68231ef6eae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-adbed41e-0ce9-41d6-b680-4342c18276ba tempest-ProjectReaderTests-889981266 None] Created volume successfully. Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-72b76852-e6f1-4332-98a5-6b4e99e6b6d2-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-72b76852-e6f1-4332-98a5-6b4e99e6b6d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Acquiring lock "cinder-quobyte-72b76852-e6f1-4332-98a5-6b4e99e6b6d2" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-72b76852-e6f1-4332-98a5-6b4e99e6b6d2" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34da7aa-5eda-4c60-ab3e-15fac7af763e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:01 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 Sep 01 02:20:01 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:01 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2" returned: 0 in 0.373s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:01 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2 Sep 01 02:20:01 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:01 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-72b76852-e6f1-4332-98a5-6b4e99e6b6d2" returned: 0 in 0.238s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-quobyte-72b76852-e6f1-4332-98a5-6b4e99e6b6d2" released by "delete_volume" :: held 0.651s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Created reservations ['b5382c70-7647-4f7d-a412-9bab36e47ef8', 'b9dbfc12-1393-4060-9d2d-3c1e2c18133c', 'fb972154-4f4f-41f8-88b5-6863564beb84', 'edae5b17-dd77-4f00-a273-cbd541c777c2'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:01 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:01 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:02 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.240s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:02 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Deleted volume successfully. Sep 01 02:20:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5c16ea92-3642-45f0-b512-755368dd82b0 tempest-ProjectReaderTests-889981266 None] Lock "cinder-72b76852-e6f1-4332-98a5-6b4e99e6b6d2-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:11 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=63,cinder:INSERT=27,cinder:UPDATE=87,cinder:DELETE=5 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=104,cinder:SELECT=71,cinder:INSERT=18,cinder:DELETE=12 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Flow 'volume_create_manager' (46a57a8e-d7d7-46f7-98de-89222d0d292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb99ec-ae47-407d-8380-7d67c7865872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb99ec-ae47-407d-8380-7d67c7865872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca8c562-1c2d-4736-b5ab-36d5f324c81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac328114524b4ac0bdf7387bae3c8a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:14Z,use_quota=True,user_id='094386afc62d454f87f85c95f3c973a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51073409-dc52-48cb-92cd-7304b7a07e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51073409-dc52-48cb-92cd-7304b7a07e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2a91e8-3b8d-49e7-8b57-19c48d27b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2a91e8-3b8d-49e7-8b57-19c48d27b73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca8c562-1c2d-4736-b5ab-36d5f324c81a', 'volume_name': 'volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ee59e1-5488-4563-bc9b-7454bbc3d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ee59e1-5488-4563-bc9b-7454bbc3d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b4528f-f5d6-474d-8c42-a1b771708363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Volume fca8c562-1c2d-4736-b5ab-36d5f324c81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a', 'volume_size': 1} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca8c562-1c2d-4736-b5ab-36d5f324c81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac328114524b4ac0bdf7387bae3c8a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:14Z,use_quota=True,user_id='094386afc62d454f87f85c95f3c973a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Creating volume fca8c562-1c2d-4736-b5ab-36d5f324c81a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:14 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:14 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a 1073741824 Sep 01 02:20:14 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (97402d3d-3b07-41c9-8797-c4c005d4895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda6712f-7829-4c4f-888a-d7655ce7132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda6712f-7829-4c4f-888a-d7655ce7132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370146863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50941bad-adf2-4510-a0df-c1f0799e031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:15Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e9c1e7-3b60-4c3a-927d-32663474095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e9c1e7-3b60-4c3a-927d-32663474095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e68220-778e-4e45-9c07-2e34a4db64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e68220-778e-4e45-9c07-2e34a4db64ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50941bad-adf2-4510-a0df-c1f0799e031b', 'volume_name': 'volume-50941bad-adf2-4510-a0df-c1f0799e031b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c054213e-6034-441a-ad39-61a0388a3214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:14 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c054213e-6034-441a-ad39-61a0388a3214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6da19-ca35-4ba6-a280-78ab1bf0424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Volume 50941bad-adf2-4510-a0df-c1f0799e031b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50941bad-adf2-4510-a0df-c1f0799e031b', 'volume_size': 1} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (d9768525-1058-4846-9259-d8bc30e8430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51389c14-d8ae-4140-b511-c5bd8b778d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51389c14-d8ae-4140-b511-c5bd8b778d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930176205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2268ca53-9d1e-4959-8f9e-18f27a1c2fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:15Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4a6be6-fb44-4f8a-8915-45be4e4e1aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4a6be6-fb44-4f8a-8915-45be4e4e1aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71dee30-646b-48c8-b48f-26b35439d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71dee30-646b-48c8-b48f-26b35439d848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2268ca53-9d1e-4959-8f9e-18f27a1c2fca', 'volume_name': 'volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296de75-8ce2-4710-8bd5-7013c18cc6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296de75-8ce2-4710-8bd5-7013c18cc6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a69bf-16d6-4508-94c4-abb685f97209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Volume 2268ca53-9d1e-4959-8f9e-18f27a1c2fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca', 'volume_size': 1} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:15 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a 1073741824" returned: 0 in 0.690s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:15 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a Sep 01 02:20:15 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (99ea053a-243a-4a0b-9b01-767393303a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6828ec-42be-4f97-95a1-972ef29b8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6828ec-42be-4f97-95a1-972ef29b8674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-341596993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5832582-96f1-4c5f-8847-9544009ce083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:16Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da7adb-fcbd-4f88-98ae-86857a866913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da7adb-fcbd-4f88-98ae-86857a866913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c95d1f-10c7-436d-b498-9aa4009ac4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c95d1f-10c7-436d-b498-9aa4009ac4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5832582-96f1-4c5f-8847-9544009ce083', 'volume_name': 'volume-e5832582-96f1-4c5f-8847-9544009ce083', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc15cd9-2c06-4698-b856-522a766700ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc15cd9-2c06-4698-b856-522a766700ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd250d69-ab11-4f80-8dee-c31236c42e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Volume e5832582-96f1-4c5f-8847-9544009ce083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5832582-96f1-4c5f-8847-9544009ce083', 'volume_size': 1} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:15 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a" returned: 0 in 0.403s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370146863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50941bad-adf2-4510-a0df-c1f0799e031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:15Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Creating volume 50941bad-adf2-4510-a0df-c1f0799e031b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:15 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:15 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b 1073741824 Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b4528f-f5d6-474d-8c42-a1b771708363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b852557-050e-484b-af06-1805ae86d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Volume volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a (fca8c562-1c2d-4736-b5ab-36d5f324c81a): created successfully Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b852557-050e-484b-af06-1805ae86d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Flow 'volume_create_manager' (46a57a8e-d7d7-46f7-98de-89222d0d292b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:15 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0d59b69a-c892-4086-8628-f216310c7111 tempest-CinderUnicodeTest-562434493 None] Created volume successfully. Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (53e58ac6-8347-4c38-a981-4d52854fb07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad08f70-8eb2-47f2-90a6-805b59ce175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad08f70-8eb2-47f2-90a6-805b59ce175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1200424673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0f321b-91d4-40f1-98f5-21187505f248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:16Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15260f9-6bf4-4728-8b09-9b15cd7fcdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15260f9-6bf4-4728-8b09-9b15cd7fcdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c12774-f80c-44a8-84be-28dd9349e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c12774-f80c-44a8-84be-28dd9349e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0f321b-91d4-40f1-98f5-21187505f248', 'volume_name': 'volume-fe0f321b-91d4-40f1-98f5-21187505f248', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7e1819-65d7-4327-b39c-6bef1d55ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7e1819-65d7-4327-b39c-6bef1d55ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358c581-be18-41bd-936a-3588866886f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Volume fe0f321b-91d4-40f1-98f5-21187505f248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0f321b-91d4-40f1-98f5-21187505f248', 'volume_size': 1} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:16 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b 1073741824" returned: 0 in 0.654s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (b676efa2-5b5a-4929-a27c-314e12cb63d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ff43e0-12b5-4002-83e4-fac959b481f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ff43e0-12b5-4002-83e4-fac959b481f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-857602555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69632ed-bf73-45b2-9422-74cba443cbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:16Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db18c2bd-919c-4c2d-be4f-1bee3d7f53ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db18c2bd-919c-4c2d-be4f-1bee3d7f53ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec3818e-cd94-4699-ba79-81c61f4fe7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec3818e-cd94-4699-ba79-81c61f4fe7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69632ed-bf73-45b2-9422-74cba443cbfe', 'volume_name': 'volume-f69632ed-bf73-45b2-9422-74cba443cbfe', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21726b1d-b329-48bc-843e-8e4500e7ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21726b1d-b329-48bc-843e-8e4500e7ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10d2a56-0e7b-4ab1-9b3a-c27a9e39e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:16 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Volume f69632ed-bf73-45b2-9422-74cba443cbfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69632ed-bf73-45b2-9422-74cba443cbfe', 'volume_size': 1} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:16 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b Sep 01 02:20:16 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:16 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b" returned: 0 in 0.311s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930176205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2268ca53-9d1e-4959-8f9e-18f27a1c2fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:15Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Creating volume 2268ca53-9d1e-4959-8f9e-18f27a1c2fca {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:16 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6da19-ca35-4ba6-a280-78ab1bf0424d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50941bad-adf2-4510-a0df-c1f0799e031b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf431896-4bf5-4c77-8107-55c7dbb85791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca 1073741824 Sep 01 02:20:17 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Volume volume-50941bad-adf2-4510-a0df-c1f0799e031b (50941bad-adf2-4510-a0df-c1f0799e031b): created successfully Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf431896-4bf5-4c77-8107-55c7dbb85791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (97402d3d-3b07-41c9-8797-c4c005d4895d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:17 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-97426a18-e933-4f01-9264-27841d768c98 tempest-CreateVolumesFromImageTest-1004528834 None] Created volume successfully. Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Flow 'volume_create_manager' (dbef185d-a999-4165-8e51-41b2dec714b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22672d5-89fc-4d3d-b5cf-19c1628df6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22672d5-89fc-4d3d-b5cf-19c1628df6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-500103805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eabcf9-aa67-45be-b373-5e08a6b96cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac328114524b4ac0bdf7387bae3c8a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:17Z,use_quota=True,user_id='094386afc62d454f87f85c95f3c973a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7180c7-046f-4885-81cb-dc812ad705fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7180c7-046f-4885-81cb-dc812ad705fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b89b2-4118-4fe6-a942-f5aed49c3649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b89b2-4118-4fe6-a942-f5aed49c3649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15eabcf9-aa67-45be-b373-5e08a6b96cc3', 'volume_name': 'volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902448ae-c5fe-4d9f-bd9f-e93c0e69ff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902448ae-c5fe-4d9f-bd9f-e93c0e69ff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b824ba4f-1ab9-47c8-b12b-411f26308c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Volume 15eabcf9-aa67-45be-b373-5e08a6b96cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3', 'volume_size': 1} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:17 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca 1073741824" returned: 0 in 0.573s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:17 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca Sep 01 02:20:17 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:17 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.084s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-341596993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5832582-96f1-4c5f-8847-9544009ce083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:16Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Creating volume e5832582-96f1-4c5f-8847-9544009ce083 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:17 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a69bf-16d6-4508-94c4-abb685f97209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:17 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 1073741824 Sep 01 02:20:17 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a848fe-f71b-4189-836f-fb9f5242fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:17 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Volume volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca (2268ca53-9d1e-4959-8f9e-18f27a1c2fca): created successfully Sep 01 02:20:17 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a848fe-f71b-4189-836f-fb9f5242fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (d9768525-1058-4846-9259-d8bc30e8430f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e838a9af-7bc7-4819-b222-2024cf07965e tempest-CreateVolumesFromImageTest-1004528834 None] Created volume successfully. Sep 01 02:20:18 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 1073741824" returned: 0 in 0.551s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:18 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 Sep 01 02:20:18 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:18 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1200424673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0f321b-91d4-40f1-98f5-21187505f248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:16Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Creating volume fe0f321b-91d4-40f1-98f5-21187505f248 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:18 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:18 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 1073741824 Sep 01 02:20:18 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd250d69-ab11-4f80-8dee-c31236c42e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5832582-96f1-4c5f-8847-9544009ce083', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b1bb31-38fe-4a0f-a138-c8527f73a2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:18 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Volume volume-e5832582-96f1-4c5f-8847-9544009ce083 (e5832582-96f1-4c5f-8847-9544009ce083): created successfully Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b1bb31-38fe-4a0f-a138-c8527f73a2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (99ea053a-243a-4a0b-9b01-767393303a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-bfed343d-81e1-4fe7-9cea-541c26a65cdb tempest-CreateVolumesFromImageTest-1004528834 None] Created volume successfully. Sep 01 02:20:19 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 1073741824" returned: 0 in 0.532s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:19 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 Sep 01 02:20:19 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:19 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248" returned: 0 in 0.266s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-857602555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69632ed-bf73-45b2-9422-74cba443cbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f043416cd6bd481283b523efa5159514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:16Z,use_quota=True,user_id='28d57b50416f4d4d8f14f6b003e2f051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Creating volume f69632ed-bf73-45b2-9422-74cba443cbfe {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:19 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:19 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe 1073741824 Sep 01 02:20:19 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358c581-be18-41bd-936a-3588866886f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0f321b-91d4-40f1-98f5-21187505f248', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c99f3f4-1946-43a2-9a2c-9b3228b731e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Volume volume-fe0f321b-91d4-40f1-98f5-21187505f248 (fe0f321b-91d4-40f1-98f5-21187505f248): created successfully Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c99f3f4-1946-43a2-9a2c-9b3228b731e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (53e58ac6-8347-4c38-a981-4d52854fb07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:19 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d144852c-3ba1-49c3-af66-98dc7b155bb6 tempest-CreateVolumesFromImageTest-1004528834 None] Created volume successfully. Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Flow 'volume_create_manager' (2f78aac6-189c-42fc-9400-0cad8668f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:20 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5d6b5c-e4a2-4ab9-b315-f9b14f9f4749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe 1073741824" returned: 0 in 0.587s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5d6b5c-e4a2-4ab9-b315-f9b14f9f4749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777361ca-a3ed-4907-9e67-e8c75b4a7b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33e17c71d49f4b4fd8e1f3122f730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:20Z,use_quota=True,user_id='c160794e9a684b52b5b234e59cb7dccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ae8885-fb23-4220-9e8b-7ebca02d990c),volume_type_id=c6ae8885-fb23-4220-9e8b-7ebca02d990c)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db096fe9-d160-43d5-b1b0-acc1a1a767b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db096fe9-d160-43d5-b1b0-acc1a1a767b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2999f1e9-2eeb-4169-b357-a047141e2c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:20 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe Sep 01 02:20:20 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:20 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.220s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-500103805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eabcf9-aa67-45be-b373-5e08a6b96cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac328114524b4ac0bdf7387bae3c8a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:17Z,use_quota=True,user_id='094386afc62d454f87f85c95f3c973a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Creating volume 15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:20 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:20 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 1073741824 Sep 01 02:20:20 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10d2a56-0e7b-4ab1-9b3a-c27a9e39e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69632ed-bf73-45b2-9422-74cba443cbfe', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9b69d4-a52e-42b1-bddf-1fb876e68fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Volume volume-f69632ed-bf73-45b2-9422-74cba443cbfe (f69632ed-bf73-45b2-9422-74cba443cbfe): created successfully Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9b69d4-a52e-42b1-bddf-1fb876e68fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Flow 'volume_create_manager' (b676efa2-5b5a-4929-a27c-314e12cb63d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:20 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fad0a4ab-7faa-4123-8da8-b01d6e119cf7 tempest-CreateVolumesFromImageTest-1004528834 None] Created volume successfully. Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2999f1e9-2eeb-4169-b357-a047141e2c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '777361ca-a3ed-4907-9e67-e8c75b4a7b4f', 'volume_name': 'volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f', 'volume_size': 1, 'image_id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35f83bb2-3b17-49d6-8847-6663c2e177a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7a3bd6934029c192d3cb06c6c81c811', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60b33e17c71d49f4b4fd8e1f3122f730', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70d6fc464e5d81e6d15b6257b653a6ad819df5486b4c654ac3e4f23e3d3b0b69d501b450591ed5b9b9ae393614cadd2848cc182e1635d92d8f7f946c0c6f4731', 'id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35f83bb2-3b17-49d6-8847-6663c2e177a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350faba4-01f3-4e4e-a83a-ff874cafdd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350faba4-01f3-4e4e-a83a-ff874cafdd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaaaff6-3a89-4b2b-b35c-cbef8339c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Volume 777361ca-a3ed-4907-9e67-e8c75b4a7b4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f', 'volume_size': 1, 'image_id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35f83bb2-3b17-49d6-8847-6663c2e177a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7a3bd6934029c192d3cb06c6c81c811', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60b33e17c71d49f4b4fd8e1f3122f730', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70d6fc464e5d81e6d15b6257b653a6ad819df5486b4c654ac3e4f23e3d3b0b69d501b450591ed5b9b9ae393614cadd2848cc182e1635d92d8f7f946c0c6f4731', 'id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35f83bb2-3b17-49d6-8847-6663c2e177a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Trying to clone 777361ca-a3ed-4907-9e67-e8c75b4a7b4f from image 35f83bb2-3b17-49d6-8847-6663c2e177a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35f83bb2-3b17-49d6-8847-6663c2e177a3', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:20:20 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eb4f1d-e6a7-4210-82c5-9b4cb9f4cb08]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:20 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD Sep 01 02:20:20 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-f69632ed-bf73-45b2-9422-74cba443cbfe-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-f69632ed-bf73-45b2-9422-74cba443cbfe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:21 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 1073741824" returned: 0 in 0.585s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-quobyte-f69632ed-bf73-45b2-9422-74cba443cbfe" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-f69632ed-bf73-45b2-9422-74cba443cbfe" acquired by "delete_volume" :: waited 0.041s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:21 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 Sep 01 02:20:21 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:21 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ec136-9c4e-420e-881b-d6a241024766]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:21 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe Sep 01 02:20:21 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:21 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD Sep 01 02:20:21 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:21 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3" returned: 0 in 0.304s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b824ba4f-1ab9-47c8-b12b-411f26308c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc5ced-eb47-4fd6-a387-9ea48f1957a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Volume volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 (15eabcf9-aa67-45be-b373-5e08a6b96cc3): created successfully Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc5ced-eb47-4fd6-a387-9ea48f1957a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Flow 'volume_create_manager' (dbef185d-a999-4165-8e51-41b2dec714b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a18a988f-68b6-48b4-8b51-1ab20c6a9268 tempest-CinderUnicodeTest-562434493 None] Created volume successfully. Sep 01 02:20:21 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:21 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Temporary image 35f83bb2-3b17-49d6-8847-6663c2e177a3 is fetched for user c160794e9a684b52b5b234e59cb7dccf. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe" returned: 0 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:21 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe Sep 01 02:20:21 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98afc84-7ef3-4046-a157-3278d3d9bbfb]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:21 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD Sep 01 02:20:21 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:21 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f69632ed-bf73-45b2-9422-74cba443cbfe" returned: 0 in 0.249s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-f69632ed-bf73-45b2-9422-74cba443cbfe" released by "delete_volume" :: held 0.685s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:21 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Created reservations ['a7885997-88a1-4972-9d3c-79f15becfc1c', 'cfe30e62-94cd-4f4d-9eff-d7c4c84561ff', '30bb2795-3b6e-4022-87db-3dcf6a8c949a', '297a687d-fa9e-4014-ad68-a9de1e1d7fe8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:22 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:22 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:22 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:22 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD Sep 01 02:20:22 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:22 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.268s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:22 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Deleted volume successfully. Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-fe0f321b-91d4-40f1-98f5-21187505f248-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-fe0f321b-91d4-40f1-98f5-21187505f248-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0f8f1441-25d9-4d23-add7-f73aad413e0c tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-f69632ed-bf73-45b2-9422-74cba443cbfe-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-quobyte-fe0f321b-91d4-40f1-98f5-21187505f248" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:22 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777361ca-a3ed-4907-9e67-e8c75b4a7b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33e17c71d49f4b4fd8e1f3122f730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:20Z,use_quota=True,user_id='c160794e9a684b52b5b234e59cb7dccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ae8885-fb23-4220-9e8b-7ebca02d990c),volume_type_id=c6ae8885-fb23-4220-9e8b-7ebca02d990c)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Creating volume 777361ca-a3ed-4907-9e67-e8c75b4a7b4f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:22 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-fe0f321b-91d4-40f1-98f5-21187505f248" acquired by "delete_volume" :: waited 0.054s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:22 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f 1073741824 Sep 01 02:20:22 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0ac42-ab26-43aa-aa1f-3a098d20af28]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:22 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 Sep 01 02:20:22 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:23 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248" returned: 0 in 0.430s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248 Sep 01 02:20:23 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f 1073741824" returned: 0 in 0.536s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f Sep 01 02:20:23 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fe0f321b-91d4-40f1-98f5-21187505f248" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-fe0f321b-91d4-40f1-98f5-21187505f248" released by "delete_volume" :: held 0.766s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:23 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" returned: 0 in 0.287s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.473s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Created reservations ['28b37122-8a27-4673-a9f5-109437b4cd2e', 'f426f9e6-3c5c-4d13-92cf-c2d4bf14cd5f', '5189bb3d-ce96-4980-af28-ef7e52cc9b05', '2c5c03e4-ee3a-4e14-ba45-ff6fa2b101d8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Creating offline snapshot 9f099c3f-12f1-46e0-a9c1-69be224e88d8 of volume 15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39588b-f06b-4f17-9821-7efcf32ffb6a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Attempting download of 35f83bb2-3b17-49d6-8847-6663c2e177a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/35f83bb2-3b17-49d6-8847-6663c2e177a3', 'metadata': {}}])) to volume 777361ca-a3ed-4907-9e67-e8c75b4a7b4f. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74bf26f-5801-4f36-83f2-36ebbb6daa9b]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 Sep 01 02:20:23 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:23 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu Sep 01 02:20:23 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-e5832582-96f1-4c5f-8847-9544009ce083-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-e5832582-96f1-4c5f-8847-9544009ce083-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-quobyte-e5832582-96f1-4c5f-8847-9544009ce083" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-e5832582-96f1-4c5f-8847-9544009ce083" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f016b05-6b03-4b41-8c54-83b7904c883b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu" returned: 0 in 0.408s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 Sep 01 02:20:23 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.405s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:23 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3" returned: 0 in 0.566s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Deleted volume successfully. Sep 01 02:20:24 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 1G Sep 01 02:20:24 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-02fe4199-22c6-43b4-bdcf-771e78c7e1c6 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-fe0f321b-91d4-40f1-98f5-21187505f248-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:24 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu Sep 01 02:20:24 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083" returned: 0 in 0.405s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083 Sep 01 02:20:24 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu" returned: 1 in 0.373s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35f83bb2-3b17-49d6-8847-6663c2e177a3_pjzit3wu' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f79f05-0388-4313-921b-118368c89a5d]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD Sep 01 02:20:24 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 1G" returned: 0 in 0.464s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 Sep 01 02:20:24 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-e5832582-96f1-4c5f-8847-9544009ce083" returned: 0 in 0.317s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-e5832582-96f1-4c5f-8847-9544009ce083" released by "delete_volume" :: held 0.767s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Created reservations ['bb3d0ba1-1563-4255-b7bf-d3eaa03f64b4', '22600ba7-89ff-4c44-a633-3ab13d2597d9', '08a8e085-0edb-45a8-b602-11524eec3dee', 'c6ad050a-48c5-4771-94ef-49ac2651f31c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:24 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:24 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8" returned: 0 in 0.333s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 is being set with open permissions: ugo+rw Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD Sep 01 02:20:24 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 Sep 01 02:20:24 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-2268ca53-9d1e-4959-8f9e-18f27a1c2fca-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-2268ca53-9d1e-4959-8f9e-18f27a1c2fca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-quobyte-2268ca53-9d1e-4959-8f9e-18f27a1c2fca" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-2268ca53-9d1e-4959-8f9e-18f27a1c2fca" acquired by "delete_volume" :: waited 0.041s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:25 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] 35f83bb2-3b17-49d6-8847-6663c2e177a3 was raw, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[38765ac6-5542-4a24-ac93-6fb39ea02075]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f Sep 01 02:20:25 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.458s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:25 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Deleted volume successfully. Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f25307c6-ebbe-4798-b279-bf6495ba4bae tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-e5832582-96f1-4c5f-8847-9544009ce083-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info Sep 01 02:20:25 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca Sep 01 02:20:25 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info" returned: 0 in 0.315s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info is being set with open permissions: ugo+rw Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info Sep 01 02:20:25 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca" returned: 0 in 0.487s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca Sep 01 02:20:25 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" returned: 0 in 0.597s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35f83bb2-3b17-49d6-8847-6663c2e177a3__tn7c5d0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:20:25 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f 1G Sep 01 02:20:25 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2268ca53-9d1e-4959-8f9e-18f27a1c2fca" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.info" returned: 0 in 0.323s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-2268ca53-9d1e-4959-8f9e-18f27a1c2fca" released by "delete_volume" :: held 0.873s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:25 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8b5dad2c-d81a-4cfa-befe-b089eed6bfda tempest-CinderUnicodeTest-562434493 None] Create snapshot completed successfully Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Created reservations ['769dcf45-df42-4826-b01e-0dc89ba84cc4', '8656dd15-0849-47b2-aa94-d23244fda7fc', 'e540f513-9d57-47a2-8d04-6572675ddda7', 'b627ecb3-483a-44ae-a1d8-d61ec5915ea9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f 1G" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Downloaded image 35f83bb2-3b17-49d6-8847-6663c2e177a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/35f83bb2-3b17-49d6-8847-6663c2e177a3', 'metadata': {}}])) to volume 777361ca-a3ed-4907-9e67-e8c75b4a7b4f successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Temporary image 35f83bb2-3b17-49d6-8847-6663c2e177a3 for user c160794e9a684b52b5b234e59cb7dccf is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Marking volume 777361ca-a3ed-4907-9e67-e8c75b4a7b4f as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:20:26 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:26 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Copying metadata from image 35f83bb2-3b17-49d6-8847-6663c2e177a3 to 777361ca-a3ed-4907-9e67-e8c75b4a7b4f. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Creating volume glance metadata for volume 777361ca-a3ed-4907-9e67-e8c75b4a7b4f backed by image 35f83bb2-3b17-49d6-8847-6663c2e177a3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c7a3bd6934029c192d3cb06c6c81c811', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-9f099c3f-12f1-46e0-a9c1-69be224e88d8-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-9f099c3f-12f1-46e0-a9c1-69be224e88d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-quobyte-15eabcf9-aa67-45be-b373-5e08a6b96cc3" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-15eabcf9-aa67-45be-b373-5e08a6b96cc3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-quobyte-9f099c3f-12f1-46e0-a9c1-69be224e88d8" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-50941bad-adf2-4510-a0df-c1f0799e031b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-9f099c3f-12f1-46e0-a9c1-69be224e88d8" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Deleting offline snapshot 9f099c3f-12f1-46e0-a9c1-69be224e88d8 of volume 15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] snapshot_file for this snap is: volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-50941bad-adf2-4510-a0df-c1f0799e031b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaaaff6-3a89-4b2b-b35c-cbef8339c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f', 'volume_size': 1, 'image_id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35f83bb2-3b17-49d6-8847-6663c2e177a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7a3bd6934029c192d3cb06c6c81c811', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60b33e17c71d49f4b4fd8e1f3122f730', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70d6fc464e5d81e6d15b6257b653a6ad819df5486b4c654ac3e4f23e3d3b0b69d501b450591ed5b9b9ae393614cadd2848cc182e1635d92d8f7f946c0c6f4731', 'id': '35f83bb2-3b17-49d6-8847-6663c2e177a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35f83bb2-3b17-49d6-8847-6663c2e177a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a948b81-869e-470e-9cf8-73f1813c90e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062d3da-72d3-49c0-acaa-e73fad054f65]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Volume volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f (777361ca-a3ed-4907-9e67-e8c75b4a7b4f): created successfully Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a948b81-869e-470e-9cf8-73f1813c90e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Flow 'volume_create_manager' (2f78aac6-189c-42fc-9400-0cad8668f552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ff585946-7322-4aa7-a6ac-d219ccb897dd tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Created volume successfully. Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "cinder-quobyte-50941bad-adf2-4510-a0df-c1f0799e031b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Deleted volume successfully. Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-50941bad-adf2-4510-a0df-c1f0799e031b" acquired by "delete_volume" :: waited 0.030s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-42d9fbb0-95ea-4851-92fa-e2bdb61632eb tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-2268ca53-9d1e-4959-8f9e-18f27a1c2fca-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca9d4b-e394-4230-b612-f9ba0ebbabbe]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 Sep 01 02:20:26 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:26 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b Sep 01 02:20:26 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Acquiring lock "cinder-777361ca-a3ed-4907-9e67-e8c75b4a7b4f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "cinder-777361ca-a3ed-4907-9e67-e8c75b4a7b4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Acquiring lock "cinder-quobyte-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:26 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "cinder-quobyte-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8" returned: 0 in 0.423s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f6b355-5a8b-40aa-bdd8-84db1e4821fc]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f85d29-c820-47c8-97f9-b1f25c025265]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b" returned: 0 in 0.452s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f Sep 01 02:20:26 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:26 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b Sep 01 02:20:26 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:26 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 Sep 01 02:20:26 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:27 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-50941bad-adf2-4510-a0df-c1f0799e031b" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-quobyte-50941bad-adf2-4510-a0df-c1f0799e031b" released by "delete_volume" :: held 0.765s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:27 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" returned: 0 in 0.454s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:27 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3" returned: 0 in 0.472s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:27 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f Sep 01 02:20:27 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Created reservations ['7c14aa66-e157-42c0-9dd1-ec815cc1a81f', '96863602-cfb8-4cfd-b929-34b06aeefe71', 'dff201ed-5e1a-4030-b5c7-79252bd5d506', '9ba8edb4-50b2-4959-a536-f5d52def7994'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:27 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 Sep 01 02:20:27 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:27 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:27 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:27 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" returned: 0 in 0.345s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "cinder-quobyte-777361ca-a3ed-4907-9e67-e8c75b4a7b4f" released by "delete_volume" :: held 0.858s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Created reservations ['c58b7f81-a268-4413-9ff1-dfde5cc35a97', '5b1af987-5edd-44ef-8c1d-1076cf6806ad', 'db815d4c-93e3-4831-b482-5c57a46acb97', 'a13cd414-d5d0-4c52-97a3-8d99cda09f9b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:27 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8" returned: 0 in 0.475s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:27 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.376s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Deleted volume successfully. Sep 01 02:20:27 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8 Sep 01 02:20:27 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-291991d0-1cba-47e0-8e1d-00b9f7e8fd75 tempest-CreateVolumesFromImageTest-1004528834 None] Lock "cinder-50941bad-adf2-4510-a0df-c1f0799e031b-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:27 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:27 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:28 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3.9f099c3f-12f1-46e0-a9c1-69be224e88d8" returned: 0 in 0.400s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-9f099c3f-12f1-46e0-a9c1-69be224e88d8" released by "_delete_snapshot" :: held 1.931s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-15eabcf9-aa67-45be-b373-5e08a6b96cc3" released by "delete_snapshot" :: held 1.984s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:28 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.414s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Deleted volume successfully. Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-265cf001-14b2-4f73-9c34-54be078d8bfa tempest-VolumeAndVolumeTypeFromImageTest-914753977 None] Lock "cinder-777361ca-a3ed-4907-9e67-e8c75b4a7b4f-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Created reservations ['edee004d-087e-4fe0-aba4-68cdc048dd51', '47b2ead6-2414-49f9-9662-e2e7bc6d7f0c', 'b57ccdc4-3bb7-4596-b1ff-7c8c1628bc40', 'b080f0ce-ffe4-4213-bea4-fde16232d4f8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Delete snapshot completed successfully. Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-7e79af17-b769-4fa6-81c5-22ca86d48ba4 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-9f099c3f-12f1-46e0-a9c1-69be224e88d8-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:28 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:28 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:28 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:20:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:20:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-15eabcf9-aa67-45be-b373-5e08a6b96cc3-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-15eabcf9-aa67-45be-b373-5e08a6b96cc3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-quobyte-15eabcf9-aa67-45be-b373-5e08a6b96cc3" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-15eabcf9-aa67-45be-b373-5e08a6b96cc3" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1009783-d289-4d0e-bc10-591ae049a0ca]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:29 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 Sep 01 02:20:29 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:30 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3" returned: 0 in 0.516s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:30 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3 Sep 01 02:20:30 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:30 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-15eabcf9-aa67-45be-b373-5e08a6b96cc3" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-15eabcf9-aa67-45be-b373-5e08a6b96cc3" released by "delete_volume" :: held 0.884s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Created reservations ['5809ace7-f64e-4c11-ae3e-56e889c2ce06', '28ce7bbd-8fda-4dcc-9d1f-eaacd6e9336e', 'bcea322e-41e3-4ce8-b286-d404c8ee5448', 'e8c566dd-98bf-4efd-bfcf-457ed9440b63'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:30 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:30 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-fca8c562-1c2d-4736-b5ab-36d5f324c81a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-fca8c562-1c2d-4736-b5ab-36d5f324c81a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "cinder-quobyte-fca8c562-1c2d-4736-b5ab-36d5f324c81a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-fca8c562-1c2d-4736-b5ab-36d5f324c81a" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[661bee5c-72cb-4ec5-b911-4e16236f8312]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:30 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.364s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:30 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Deleted volume successfully. Sep 01 02:20:30 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a Sep 01 02:20:30 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-574e7b1d-c50a-46ed-94c1-40e8cc081188 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-15eabcf9-aa67-45be-b373-5e08a6b96cc3-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:31 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a" returned: 0 in 0.488s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:31 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a Sep 01 02:20:31 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:31 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-fca8c562-1c2d-4736-b5ab-36d5f324c81a" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-quobyte-fca8c562-1c2d-4736-b5ab-36d5f324c81a" released by "delete_volume" :: held 0.838s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Created reservations ['1a61b12f-6895-41d6-b667-29c1e6e463e6', 'cd9902fd-dc29-43ed-8e63-8fd392ca8bbd', '4a28742b-2b2e-4bdb-803a-e5db16697919', '7f6ba460-00e9-4aea-9051-e3674f22d002'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:31 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:31 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (382ed03c-a87b-49fa-8679-1778578a748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6a026e-146c-4ec7-b665-e890680d951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6a026e-146c-4ec7-b665-e890680d951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655026871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fe6fd3-cff8-4b23-a157-6c5d5aa5531f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:32Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1edf1c-77d6-42a6-a95d-20b7f8d32f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1edf1c-77d6-42a6-a95d-20b7f8d32f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45299615-4f8b-440f-9a6a-aab6cb51f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45299615-4f8b-440f-9a6a-aab6cb51f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14fe6fd3-cff8-4b23-a157-6c5d5aa5531f', 'volume_name': 'volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ebaba3-2c86-4e93-afb2-d101f727d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ebaba3-2c86-4e93-afb2-d101f727d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab4a50-f401-427e-b841-b29b5cd947e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:32 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume 14fe6fd3-cff8-4b23-a157-6c5d5aa5531f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f', 'volume_size': 1} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655026871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fe6fd3-cff8-4b23-a157-6c5d5aa5531f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:32Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating volume 14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:32 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:32 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f 1073741824 Sep 01 02:20:32 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:32 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.341s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Deleted volume successfully. Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-47d7d103-0e00-43af-9f6c-7b1ae21b9fc2 tempest-CinderUnicodeTest-562434493 None] Lock "cinder-fca8c562-1c2d-4736-b5ab-36d5f324c81a-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:32 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f 1073741824" returned: 0 in 0.546s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:32 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f Sep 01 02:20:32 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:33 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" returned: 0 in 0.394s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab4a50-f401-427e-b841-b29b5cd947e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab5876-170d-4c33-9d05-d23461951fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f (14fe6fd3-cff8-4b23-a157-6c5d5aa5531f): created successfully Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab5876-170d-4c33-9d05-d23461951fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (382ed03c-a87b-49fa-8679-1778578a748d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-574f5f53-bbf0-4c20-9fb0-41029f393fea tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created volume successfully. Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating offline snapshot ac74f514-d80d-44b9-998f-9dd0c823c362 of volume 14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (49923aa6-8dfe-4598-9e60-28270aaf5c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b862a45-53a4-4531-9b12-92f64ba22c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928064e-fb0e-4ad8-9fbe-791f3b136132]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b862a45-53a4-4531-9b12-92f64ba22c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-872909658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:35Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db042b02-b354-4ae1-98f8-ad7015fe7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db042b02-b354-4ae1-98f8-ad7015fe7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4d3078-a313-4552-a057-05ac96021d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4d3078-a313-4552-a057-05ac96021d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e', 'volume_name': 'volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049f9cd3-a6d6-4793-9680-a28b49f9501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049f9cd3-a6d6-4793-9680-a28b49f9501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7194402c-cfca-4cf2-a993-f834f2d43183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:34 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume 8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e', 'volume_size': 1} Sep 01 02:20:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:34 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f Sep 01 02:20:34 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:35 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:35 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 1G Sep 01 02:20:35 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:35 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 1G" returned: 0 in 0.488s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:35 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 Sep 01 02:20:35 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:36 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362" returned: 0 in 0.367s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:36 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 is being set with open permissions: ugo+rw Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:36 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 Sep 01 02:20:36 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:36 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:36 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info Sep 01 02:20:36 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e540d187-a753-427f-a86d-489ecdb1fdbe tempest-ProjectAdminTests-2097320136 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0434684753418, 'free_capacity_gb': 1774.0434684753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87404) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:20:36 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info" returned: 0 in 0.340s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:36 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info is being set with open permissions: ugo+rw Sep 01 02:20:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:36 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info Sep 01 02:20:36 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:37 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.info" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.197s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-872909658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:35Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Creating volume 8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:37 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:37 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e 1073741824 Sep 01 02:20:37 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e7b47189-2ecf-4d3a-9509-c513a7e1edfe tempest-CreateVolumesFromSnapshotTest-2019257638 None] Create snapshot completed successfully Sep 01 02:20:37 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e 1073741824" returned: 0 in 0.513s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:37 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e Sep 01 02:20:37 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:38 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e" returned: 0 in 0.417s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7194402c-cfca-4cf2-a993-f834f2d43183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8849938b-3881-40eb-a994-3148516da2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:38 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e (8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e): created successfully Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8849938b-3881-40eb-a994-3148516da2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (49923aa6-8dfe-4598-9e60-28270aaf5c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-30c624d4-5183-4e16-a5c6-9910dca0795a tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created volume successfully. Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (bb086a3f-2921-40cf-bdb0-b7b1ea85eb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45165423-fb6f-4d81-ad54-e4c4e010d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45165423-fb6f-4d81-ad54-e4c4e010d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138404959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcba6dc-8573-4c8a-b161-46ea4ab5a362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:38Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b675da45-d70e-47a0-94b5-aeb72996be4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b675da45-d70e-47a0-94b5-aeb72996be4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1a58fe-206b-4c8d-9514-a75708e96689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1a58fe-206b-4c8d-9514-a75708e96689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcba6dc-8573-4c8a-b161-46ea4ab5a362', 'volume_name': 'volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f024d672-3630-4d43-a757-e4370f3f27e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f024d672-3630-4d43-a757-e4370f3f27e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ea4e13-9c48-4f2d-b426-33abb9bcb772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:38 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume 5dcba6dc-8573-4c8a-b161-46ea4ab5a362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362', 'volume_size': 1} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138404959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcba6dc-8573-4c8a-b161-46ea4ab5a362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:38Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating volume 5dcba6dc-8573-4c8a-b161-46ea4ab5a362 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:38 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:38 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 1073741824 Sep 01 02:20:38 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (242d2331-c166-4308-8f6e-6c652162e9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99ac29b-1d1b-4ec1-9afe-9445d862c3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99ac29b-1d1b-4ec1-9afe-9445d862c3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807017624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e07d665-c606-493a-ba19-64f68a3119f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:39Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b408300-b37e-4f6a-9db2-fc0d41f79500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b408300-b37e-4f6a-9db2-fc0d41f79500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c572b20c-b2bf-444d-b41d-9833a26115a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c572b20c-b2bf-444d-b41d-9833a26115a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e07d665-c606-493a-ba19-64f68a3119f9', 'volume_name': 'volume-7e07d665-c606-493a-ba19-64f68a3119f9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a430c2a-a892-4060-8465-d75e19fa72cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a430c2a-a892-4060-8465-d75e19fa72cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f9900f-7e59-4d2b-9433-5c0c1cc4351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume 7e07d665-c606-493a-ba19-64f68a3119f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e07d665-c606-493a-ba19-64f68a3119f9', 'volume_size': 1} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:39 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 1073741824" returned: 0 in 0.809s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:39 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 Sep 01 02:20:39 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (59988ec7-418c-4dbf-9be9-f5cd88fd409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc12bd4-4b40-457e-9b4b-ce3dacae5243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc12bd4-4b40-457e-9b4b-ce3dacae5243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948069807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9280f9e-635e-4360-a6e9-e7b421b3fc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:40Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60f18ca-38fb-41df-a199-cb4a39373727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60f18ca-38fb-41df-a199-cb4a39373727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a716180c-d46b-4e31-b79d-43a6a879502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a716180c-d46b-4e31-b79d-43a6a879502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9280f9e-635e-4360-a6e9-e7b421b3fc34', 'volume_name': 'volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9afea74-7808-4fa0-b4a1-e037a593ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9afea74-7808-4fa0-b4a1-e037a593ab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f138ff45-600e-4f96-8412-d378e87553f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume f9280f9e-635e-4360-a6e9-e7b421b3fc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34', 'volume_size': 1} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:39 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362" returned: 0 in 0.352s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807017624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e07d665-c606-493a-ba19-64f68a3119f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:39Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating volume 7e07d665-c606-493a-ba19-64f68a3119f9 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:39 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ea4e13-9c48-4f2d-b426-33abb9bcb772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5454126-e373-40f5-9921-99492d610b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:39 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 1073741824 Sep 01 02:20:39 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:39 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 (5dcba6dc-8573-4c8a-b161-46ea4ab5a362): created successfully Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5454126-e373-40f5-9921-99492d610b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (bb086a3f-2921-40cf-bdb0-b7b1ea85eb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (192ece57-41ac-4e75-b8ea-06dec3aeb96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2192b5-b26f-4fbb-bcf5-649e7237ec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2192b5-b26f-4fbb-bcf5-649e7237ec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368752089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1585e2b2-e6d3-498c-ab90-034677589d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:40Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a7b0f7-9eec-4398-b724-7f7d14c6826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a7b0f7-9eec-4398-b724-7f7d14c6826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74294122-3e30-4749-9194-ae3875389e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74294122-3e30-4749-9194-ae3875389e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1585e2b2-e6d3-498c-ab90-034677589d0a', 'volume_name': 'volume-1585e2b2-e6d3-498c-ab90-034677589d0a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dcffa4-763f-40b3-8427-536b8eeda264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dcffa4-763f-40b3-8427-536b8eeda264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255409b7-88fc-49fc-a8d8-d30342fc85d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:40 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume 1585e2b2-e6d3-498c-ab90-034677589d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1585e2b2-e6d3-498c-ab90-034677589d0a', 'volume_size': 1} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e1dedb94-343f-4702-82ce-62ede1a567fd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created volume successfully. Sep 01 02:20:40 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 1073741824" returned: 0 in 0.703s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:40 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 Sep 01 02:20:40 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:40 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (272ba753-db1f-4dde-bc2c-c8ed1fc8d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1a12ca-70ed-4baf-80f7-3ee30f21bd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1a12ca-70ed-4baf-80f7-3ee30f21bd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107980555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b6247f-bfb7-4d96-bea6-6df1546a85bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:41Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821caad6-7c69-44ad-85ac-19b9396d0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821caad6-7c69-44ad-85ac-19b9396d0b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2583a49-98e2-4067-8d34-6ea7a3c0a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2583a49-98e2-4067-8d34-6ea7a3c0a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b6247f-bfb7-4d96-bea6-6df1546a85bc', 'volume_name': 'volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef51fbeb-42f3-4b66-8001-1dcfcc083888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef51fbeb-42f3-4b66-8001-1dcfcc083888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f98777-1aa1-4dfa-af84-903aee0cfaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume 03b6247f-bfb7-4d96-bea6-6df1546a85bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc', 'volume_size': 1} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9" returned: 0 in 0.529s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948069807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9280f9e-635e-4360-a6e9-e7b421b3fc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:40Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating volume f9280f9e-635e-4360-a6e9-e7b421b3fc34 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:41 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f9900f-7e59-4d2b-9433-5c0c1cc4351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e07d665-c606-493a-ba19-64f68a3119f9', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 1073741824 Sep 01 02:20:41 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a4132a-32a0-4a6f-bb90-bb99566cc2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume volume-7e07d665-c606-493a-ba19-64f68a3119f9 (7e07d665-c606-493a-ba19-64f68a3119f9): created successfully Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a4132a-32a0-4a6f-bb90-bb99566cc2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (242d2331-c166-4308-8f6e-6c652162e9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:41 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f2b70b38-b7ae-4da7-9bc5-75b6a4a46aa0 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created volume successfully. Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (896f4714-c37a-45b6-a61f-660941ae7d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17589a56-18c8-4755-bc84-72b9fdfc3e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17589a56-18c8-4755-bc84-72b9fdfc3e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5750484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23ca1f-bbff-4600-8b60-eb5e4dc074f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:41Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba3aeb2-a73e-4938-a165-600f7b376acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba3aeb2-a73e-4938-a165-600f7b376acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb33338c-6971-4366-a5c1-06798a4b6e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb33338c-6971-4366-a5c1-06798a4b6e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f23ca1f-bbff-4600-8b60-eb5e4dc074f3', 'volume_name': 'volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ba4f84-31a6-44d8-bdaa-aa430330f2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ba4f84-31a6-44d8-bdaa-aa430330f2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa468bd2-d7cd-41a8-ac8f-34ce3c57cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Volume 6f23ca1f-bbff-4600-8b60-eb5e4dc074f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3', 'volume_size': 1} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 1073741824" returned: 0 in 0.708s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (9daf2ada-0897-4ad9-bf97-74a29b5be8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57dafa5-dac4-42fa-a6d5-9a1611416d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57dafa5-dac4-42fa-a6d5-9a1611416d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1921310536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734ab410-770f-4ae3-a77a-01ace2e4abf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:42Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fe9867-a8c5-4ca2-98aa-474dae887130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fe9867-a8c5-4ca2-98aa-474dae887130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e17387-3f86-41e5-911b-348ab0d83af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e17387-3f86-41e5-911b-348ab0d83af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734ab410-770f-4ae3-a77a-01ace2e4abf3', 'volume_name': 'volume-734ab410-770f-4ae3-a77a-01ace2e4abf3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e82a55-7283-4605-82e1-a0c39d60da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e82a55-7283-4605-82e1-a0c39d60da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7181b4-dac5-4307-8ac7-3f67fa3f5a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume 734ab410-770f-4ae3-a77a-01ace2e4abf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734ab410-770f-4ae3-a77a-01ace2e4abf3', 'volume_size': 1} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:42 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 Sep 01 02:20:42 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (6fadb398-badf-4d51-9f05-20e1382b994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df62c99b-d26b-4be3-8f92-cc8e6f0a10c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (bfb660d4-c51e-4aa1-9c4e-d32d83e3013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2bee79-7b8a-4d9b-ba0e-4acf1fcb0b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df62c99b-d26b-4be3-8f92-cc8e6f0a10c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700054367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a920d722-bf8e-46e2-a6f3-8eb88ea67011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:42Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1654d454-b1ba-47e3-8699-a90e6d2df4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1654d454-b1ba-47e3-8699-a90e6d2df4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af57e05d-43d4-4880-babc-308bb23b11c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af57e05d-43d4-4880-babc-308bb23b11c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a920d722-bf8e-46e2-a6f3-8eb88ea67011', 'volume_name': 'volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e2eda-a873-4609-9ff0-e34a2e48077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e2eda-a873-4609-9ff0-e34a2e48077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa212d48-a5a7-477d-8c4c-eeee01177041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume a920d722-bf8e-46e2-a6f3-8eb88ea67011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011', 'volume_size': 1} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2bee79-7b8a-4d9b-ba0e-4acf1fcb0b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934950880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88b58cc-659a-4af4-874d-7499c98b8311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:42Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca8e9be-8ee7-4178-ad3c-9d6720ce1d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca8e9be-8ee7-4178-ad3c-9d6720ce1d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb90ee0e-4977-4667-8e4e-da3fd5031e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb90ee0e-4977-4667-8e4e-da3fd5031e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88b58cc-659a-4af4-874d-7499c98b8311', 'volume_name': 'volume-a88b58cc-659a-4af4-874d-7499c98b8311', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a710ea4-4ace-4e77-af8d-129f43d4c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a710ea4-4ace-4e77-af8d-129f43d4c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2caf998-f567-40f9-a51e-a214d5223c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume a88b58cc-659a-4af4-874d-7499c98b8311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88b58cc-659a-4af4-874d-7499c98b8311', 'volume_size': 1} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34" returned: 0 in 0.428s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368752089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1585e2b2-e6d3-498c-ab90-034677589d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:40Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Creating volume 1585e2b2-e6d3-498c-ab90-034677589d0a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f138ff45-600e-4f96-8412-d378e87553f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a 1073741824 Sep 01 02:20:42 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f03ab0-9553-4d29-8dda-198634b37e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 (f9280f9e-635e-4360-a6e9-e7b421b3fc34): created successfully Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f03ab0-9553-4d29-8dda-198634b37e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (59988ec7-418c-4dbf-9be9-f5cd88fd409b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-22c3a41b-a0e7-47ae-920e-8138feffa65d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created volume successfully. Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (f0a0c181-5d60-431c-99c3-3057662919ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc9d44f-4933-4160-8ab1-0d5de4da8ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (51a377b8-9726-4f73-9375-7979cf0adc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b247aa3-4cec-464c-ab18-12935d54e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b247aa3-4cec-464c-ab18-12935d54e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871989884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5487155-a155-4b35-94af-3b196a9fe735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:43Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1d71de-cefb-499b-a872-00ff54a2d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1d71de-cefb-499b-a872-00ff54a2d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b39cf49-a18e-43d5-87f8-486d441038b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b39cf49-a18e-43d5-87f8-486d441038b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5487155-a155-4b35-94af-3b196a9fe735', 'volume_name': 'volume-b5487155-a155-4b35-94af-3b196a9fe735', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ac1e11-01dc-4ec1-a904-a41d2dec48a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ac1e11-01dc-4ec1-a904-a41d2dec48a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11a238c-24ff-48bd-801b-8b84ebf6a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Volume b5487155-a155-4b35-94af-3b196a9fe735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5487155-a155-4b35-94af-3b196a9fe735', 'volume_size': 1} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc9d44f-4933-4160-8ab1-0d5de4da8ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-153639459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309624a6-b5ee-460e-aa20-8da2723f610a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:43Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31208736-f715-4960-adec-3bc91bad92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31208736-f715-4960-adec-3bc91bad92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6ca307-5b9b-437e-a81f-48d51990a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6ca307-5b9b-437e-a81f-48d51990a575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309624a6-b5ee-460e-aa20-8da2723f610a', 'volume_name': 'volume-309624a6-b5ee-460e-aa20-8da2723f610a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1c14cf-0c64-4710-997a-ba94256acd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1c14cf-0c64-4710-997a-ba94256acd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a19bba-0ee8-44cc-bf7e-16ad73846afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume 309624a6-b5ee-460e-aa20-8da2723f610a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309624a6-b5ee-460e-aa20-8da2723f610a', 'volume_size': 1} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (e0f96535-93bc-4482-bbf3-78f177479eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba6d1b2-63fc-4d25-ab50-7f16ee982988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba6d1b2-63fc-4d25-ab50-7f16ee982988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89958617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ca11a-d6cd-4db7-88cd-019555dea61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:43Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b6cc4d-abd0-47e4-ba71-09c3cd67a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b6cc4d-abd0-47e4-ba71-09c3cd67a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab45bd8-4004-49d2-82ad-5d0d6d922ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab45bd8-4004-49d2-82ad-5d0d6d922ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6ca11a-d6cd-4db7-88cd-019555dea61b', 'volume_name': 'volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e13645-207c-470f-8499-79a43be79620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e13645-207c-470f-8499-79a43be79620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56c21b7-0e88-4233-a0c3-dcbfa32e29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:42 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume ea6ca11a-d6cd-4db7-88cd-019555dea61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b', 'volume_size': 1} Sep 01 02:20:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:43 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a 1073741824" returned: 0 in 0.502s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:43 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a Sep 01 02:20:43 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:43 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107980555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b6247f-bfb7-4d96-bea6-6df1546a85bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:41Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating volume 03b6247f-bfb7-4d96-bea6-6df1546a85bc {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:43 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255409b7-88fc-49fc-a8d8-d30342fc85d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1585e2b2-e6d3-498c-ab90-034677589d0a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:43 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc 1073741824 Sep 01 02:20:43 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a92df33-c84c-4aed-b87f-b68573d58108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:43 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume volume-1585e2b2-e6d3-498c-ab90-034677589d0a (1585e2b2-e6d3-498c-ab90-034677589d0a): created successfully Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a92df33-c84c-4aed-b87f-b68573d58108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (192ece57-41ac-4e75-b8ea-06dec3aeb96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4022f04e-c1f3-4378-a12f-4ccaf4e523e2 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created volume successfully. Sep 01 02:20:43 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc 1073741824" returned: 0 in 0.413s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:43 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc Sep 01 02:20:43 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:43 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc" returned: 0 in 0.234s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5750484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f23ca1f-bbff-4600-8b60-eb5e4dc074f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:41Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Creating volume 6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:43 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f98777-1aa1-4dfa-af84-903aee0cfaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:44 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 1073741824 Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81cf41f-72cd-41df-af56-0ee308523952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:44 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:44 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc (03b6247f-bfb7-4d96-bea6-6df1546a85bc): created successfully Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81cf41f-72cd-41df-af56-0ee308523952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (272ba753-db1f-4dde-bc2c-c8ed1fc8d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ac097c14-6924-4331-bd75-95be973b7ebd tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created volume successfully. Sep 01 02:20:44 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 1073741824" returned: 0 in 0.415s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:44 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 Sep 01 02:20:44 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:44 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1921310536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734ab410-770f-4ae3-a77a-01ace2e4abf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:42Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Creating volume 734ab410-770f-4ae3-a77a-01ace2e4abf3 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:44 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:44 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 1073741824 Sep 01 02:20:44 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa468bd2-d7cd-41a8-ac8f-34ce3c57cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c832be-6fa3-4af2-b18f-5462a4244a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:44 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Volume volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 (6f23ca1f-bbff-4600-8b60-eb5e4dc074f3): created successfully Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c832be-6fa3-4af2-b18f-5462a4244a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:44 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (896f4714-c37a-45b6-a61f-660941ae7d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a2d6c423-37ff-4b5b-bcee-43a0ff431d5b tempest-ProjectReaderTests-714298595 None] Created volume successfully. Sep 01 02:20:45 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 1073741824" returned: 0 in 0.416s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:45 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 Sep 01 02:20:45 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:45 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3" returned: 0 in 0.259s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700054367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a920d722-bf8e-46e2-a6f3-8eb88ea67011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841653fbb754dd09eba1257c80aec40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:42Z,use_quota=True,user_id='e223d601c19e4eecbcf9f9c109d9d4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Creating volume a920d722-bf8e-46e2-a6f3-8eb88ea67011 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:45 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7181b4-dac5-4307-8ac7-3f67fa3f5a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734ab410-770f-4ae3-a77a-01ace2e4abf3', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:45 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 1073741824 Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3497d3b-3efe-4661-93e4-067ce1e6562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:45 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:45 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 (734ab410-770f-4ae3-a77a-01ace2e4abf3): created successfully Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3497d3b-3efe-4661-93e4-067ce1e6562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (9daf2ada-0897-4ad9-bf97-74a29b5be8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:45 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dabf1649-a883-4cf7-9927-56b6caba80dd tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created volume successfully. Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Lock "cinder-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-quobyte-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc012ab-81bb-4e5e-b6fc-2f3490339169]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:45 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 Sep 01 02:20:45 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:45 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 1073741824" returned: 0 in 0.485s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:45 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 Sep 01 02:20:45 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3" returned: 0 in 0.372s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3 Sep 01 02:20:46 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011" returned: 0 in 0.256s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.892s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934950880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88b58cc-659a-4af4-874d-7499c98b8311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:42Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Creating volume a88b58cc-659a-4af4-874d-7499c98b8311 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:46 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa212d48-a5a7-477d-8c4c-eeee01177041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:46 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 1073741824 Sep 01 02:20:46 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8471e8-ad51-43fd-a388-d55712cae7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:46 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Volume volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 (a920d722-bf8e-46e2-a6f3-8eb88ea67011): created successfully Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8471e8-ad51-43fd-a388-d55712cae7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Flow 'volume_create_manager' (6fadb398-badf-4d51-9f05-20e1382b994a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0243556a-4749-4bbc-a41d-da6ec6fb2263 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created volume successfully. Sep 01 02:20:46 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3" returned: 0 in 0.253s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3" released by "delete_volume" :: held 0.663s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Created reservations ['94eb3be6-3bc3-4fe6-8a3c-01d5d5bc4ffb', '55a93506-28eb-418a-9e98-542115815e89', 'dc336534-9358-4eef-aab4-30e5575cc774', '303e36fe-b1f0-4205-8626-15d0fd546eaa'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:46 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 1073741824" returned: 0 in 0.437s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 Sep 01 02:20:46 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Deleted volume successfully. Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fca0500f-cc1e-45df-8727-5e83b18bfcaf tempest-ProjectReaderTests-714298595 None] Lock "cinder-6f23ca1f-bbff-4600-8b60-eb5e4dc074f3-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-a920d722-bf8e-46e2-a6f3-8eb88ea67011-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-a920d722-bf8e-46e2-a6f3-8eb88ea67011-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:46 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871989884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5487155-a155-4b35-94af-3b196a9fe735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:43Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Creating volume b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:46 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-a920d722-bf8e-46e2-a6f3-8eb88ea67011" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2caf998-f567-40f9-a51e-a214d5223c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88b58cc-659a-4af4-874d-7499c98b8311', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7749022-05b2-41b1-b754-115ae7df4a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 1073741824 Sep 01 02:20:47 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-a920d722-bf8e-46e2-a6f3-8eb88ea67011" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume volume-a88b58cc-659a-4af4-874d-7499c98b8311 (a88b58cc-659a-4af4-874d-7499c98b8311): created successfully Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7749022-05b2-41b1-b754-115ae7df4a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (bfb660d4-c51e-4aa1-9c4e-d32d83e3013d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b87aef8-76bc-40f6-a85e-fdc66bdb87fa]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-da6c5fb5-5b64-41c1-bf8b-b58c07e6ef22 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created volume successfully. Sep 01 02:20:47 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 Sep 01 02:20:47 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (e6273067-2306-4e5d-b5f6-900af3cc42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eb7867-e9d0-49e1-91da-ed59c463b557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eb7867-e9d0-49e1-91da-ed59c463b557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918652622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2e55b9-0985-4d96-bbf5-4210b44c71df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:47Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6719e785-2868-4d53-8e23-0e8b85408827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6719e785-2868-4d53-8e23-0e8b85408827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a3e27c-f359-414f-a34c-34d62bb59195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a3e27c-f359-414f-a34c-34d62bb59195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2e55b9-0985-4d96-bbf5-4210b44c71df', 'volume_name': 'volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09adc8b-f9b9-414f-9a81-cb7a66ee8a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09adc8b-f9b9-414f-9a81-cb7a66ee8a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7904f3-a3d0-4b83-8011-aebe7ffbc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Volume ec2e55b9-0985-4d96-bbf5-4210b44c71df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df', 'volume_size': 1} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:47 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011" returned: 0 in 0.453s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 1073741824" returned: 0 in 0.560s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011 Sep 01 02:20:47 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 Sep 01 02:20:47 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a920d722-bf8e-46e2-a6f3-8eb88ea67011" returned: 0 in 0.274s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-a920d722-bf8e-46e2-a6f3-8eb88ea67011" released by "delete_volume" :: held 0.783s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['84d5e1e1-cfe3-42e1-978e-7fdb0c4879aa', '9a652b4e-6a06-48e9-9393-6035a3b24b26', '2faa581e-fffc-4a84-9bd7-4c1880105230', '7843a21b-80d0-4da7-ae9d-b9d28987c452'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:47 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735" returned: 0 in 0.297s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-153639459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309624a6-b5ee-460e-aa20-8da2723f610a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:43Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Creating volume 309624a6-b5ee-460e-aa20-8da2723f610a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:47 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a 1073741824 Sep 01 02:20:47 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11a238c-24ff-48bd-801b-8b84ebf6a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5487155-a155-4b35-94af-3b196a9fe735', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3952c08-ca01-4eb8-87f1-2519d9502d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Volume volume-b5487155-a155-4b35-94af-3b196a9fe735 (b5487155-a155-4b35-94af-3b196a9fe735): created successfully Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3952c08-ca01-4eb8-87f1-2519d9502d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (51a377b8-9726-4f73-9375-7979cf0adc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-029cd48b-d60b-4931-b452-75e3bc28472b tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:48 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:48 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-03b6247f-bfb7-4d96-bea6-6df1546a85bc-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-03b6247f-bfb7-4d96-bea6-6df1546a85bc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-03b6247f-bfb7-4d96-bea6-6df1546a85bc" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-03b6247f-bfb7-4d96-bea6-6df1546a85bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864a805-3e0a-4d90-a977-f7c576b427cb]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:48 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.322s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleted volume successfully. Sep 01 02:20:48 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc Sep 01 02:20:48 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d10fcf2d-e10e-42bb-bc6c-6a6ded755389 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-a920d722-bf8e-46e2-a6f3-8eb88ea67011-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:48 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a 1073741824" returned: 0 in 0.518s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:48 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a Sep 01 02:20:48 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc" returned: 0 in 0.400s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:48 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc Sep 01 02:20:48 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.792s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89958617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ca11a-d6cd-4db7-88cd-019555dea61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cabdc5f19741c3ad032401054b463d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:43Z,use_quota=True,user_id='007ef5378e3345dca9ac115a775d26d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Creating volume ea6ca11a-d6cd-4db7-88cd-019555dea61b {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:48 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a19bba-0ee8-44cc-bf7e-16ad73846afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309624a6-b5ee-460e-aa20-8da2723f610a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:48 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b 1073741824 Sep 01 02:20:48 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7beade57-5f4c-46e9-940d-7756bbf6ffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:48 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume volume-309624a6-b5ee-460e-aa20-8da2723f610a (309624a6-b5ee-460e-aa20-8da2723f610a): created successfully Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7beade57-5f4c-46e9-940d-7756bbf6ffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (f0a0c181-5d60-431c-99c3-3057662919ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:48 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2d861d9f-02f1-437e-acd9-383f99a1d7eb tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created volume successfully. Sep 01 02:20:48 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-03b6247f-bfb7-4d96-bea6-6df1546a85bc" returned: 0 in 0.295s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-03b6247f-bfb7-4d96-bea6-6df1546a85bc" released by "delete_volume" :: held 0.744s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:48 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['3459fed1-f37d-489a-8d12-fda58f5be8fa', '0644fa50-e1f3-42cd-9faf-268635fe0977', '06b3e8ac-b5cb-4d79-a23d-2c5811f847e7', 'e410c952-793d-4557-a477-38f1f1111bd8'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:49 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:49 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-f9280f9e-635e-4360-a6e9-e7b421b3fc34-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-f9280f9e-635e-4360-a6e9-e7b421b3fc34-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-f9280f9e-635e-4360-a6e9-e7b421b3fc34" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-f9280f9e-635e-4360-a6e9-e7b421b3fc34" acquired by "delete_volume" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:49 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b 1073741824" returned: 0 in 0.665s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:49 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[374ec436-b67c-49c1-9102-278adca63be1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleted volume successfully. Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-9379ed95-a6a2-49a4-879a-190e8d6f69e5 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-03b6247f-bfb7-4d96-bea6-6df1546a85bc-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:49 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b Sep 01 02:20:49 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:49 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 Sep 01 02:20:49 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:49 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918652622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2e55b9-0985-4d96-bbf5-4210b44c71df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:47Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Creating volume ec2e55b9-0985-4d96-bbf5-4210b44c71df {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:49 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56c21b7-0e88-4233-a0c3-dcbfa32e29b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:49 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df 1073741824 Sep 01 02:20:49 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cc4895-80e3-4988-a254-37714d3e6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Volume volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b (ea6ca11a-d6cd-4db7-88cd-019555dea61b): created successfully Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cc4895-80e3-4988-a254-37714d3e6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Flow 'volume_create_manager' (e0f96535-93bc-4482-bbf3-78f177479eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2b053849-0186-462a-9aa4-8663d2c30d78 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created volume successfully. Sep 01 02:20:49 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34" returned: 0 in 0.412s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:49 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34 Sep 01 02:20:49 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:50 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9280f9e-635e-4360-a6e9-e7b421b3fc34" returned: 0 in 0.278s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-f9280f9e-635e-4360-a6e9-e7b421b3fc34" released by "delete_volume" :: held 0.744s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:50 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df 1073741824" returned: 0 in 0.430s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['0c25c7cd-8d0b-47f3-b993-9616aa99c6d7', 'ac7103f1-3aa2-4697-a083-2384c1b57c4a', 'a71d93d7-c861-4d95-84c6-0e8658c22109', 'a0725654-c86e-488f-861f-9b698dddfb8f'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:50 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df Sep 01 02:20:50 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:50 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:50 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:50 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-7e07d665-c606-493a-ba19-64f68a3119f9-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.132s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-7e07d665-c606-493a-ba19-64f68a3119f9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Creating offline snapshot a2174044-8d5e-4532-8e7b-9cc491ac721a of volume b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7904f3-a3d0-4b83-8011-aebe7ffbc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5861d4e8-5bef-4ebf-942f-35066b11de89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:50 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c487d0dc-48bf-49e8-ad59-1e4fd13c6984]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.314s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Volume volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df (ec2e55b9-0985-4d96-bbf5-4210b44c71df): created successfully Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5861d4e8-5bef-4ebf-942f-35066b11de89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (e6273067-2306-4e5d-b5f6-900af3cc42d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-ea6ca11a-d6cd-4db7-88cd-019555dea61b-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:50 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleted volume successfully. Sep 01 02:20:50 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-86b7452b-1a78-4f78-a760-3955622ad995 tempest-ProjectReaderTests-714298595 None] Created volume successfully. Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-7e07d665-c606-493a-ba19-64f68a3119f9" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-ea6ca11a-d6cd-4db7-88cd-019555dea61b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-aa85cc17-b410-41c9-ad8c-5e08b4a12124 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-f9280f9e-635e-4360-a6e9-e7b421b3fc34-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-7e07d665-c606-493a-ba19-64f68a3119f9" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f63f7a-4994-4dec-a63d-7c23a92611e3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:50 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:50 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-quobyte-ea6ca11a-d6cd-4db7-88cd-019555dea61b" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-ea6ca11a-d6cd-4db7-88cd-019555dea61b" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af975a1-7a8a-481f-afdc-4c33afea3a3f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:50 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 Sep 01 02:20:50 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:50 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b Sep 01 02:20:50 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:51 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735" returned: 0 in 0.423s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:51 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a 1G Sep 01 02:20:51 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:51 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9" returned: 0 in 0.409s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:51 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9 Sep 01 02:20:51 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:51 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b" returned: 0 in 0.440s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:51 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b Sep 01 02:20:51 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:51 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-7e07d665-c606-493a-ba19-64f68a3119f9" returned: 0 in 0.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-7e07d665-c606-493a-ba19-64f68a3119f9" released by "delete_volume" :: held 0.786s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['74ac783f-955e-4507-8c81-1866f931f230', 'de63e0d4-51f9-496f-9856-11b82e6477a8', 'd05f9eee-4eb6-4eae-b78c-297c716b74a9', '985e07d8-dd15-45e0-8884-c613c9954d98'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:51 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a 1G" returned: 0 in 0.553s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5487155-a155-4b35-94af-3b196a9fe735 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:51 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ea6ca11a-d6cd-4db7-88cd-019555dea61b" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:51 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5487155-a155-4b35-94af-3b196a9fe735 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a Sep 01 02:20:51 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-ea6ca11a-d6cd-4db7-88cd-019555dea61b" released by "delete_volume" :: held 0.837s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created reservations ['d4565727-a14b-45cb-a0ec-cfa0a920e6cd', '43ba689e-fe22-4717-b78b-8dde6816cee2', 'b7ea572b-9ddf-4e71-9e9e-3aec15aa19de', '22beee19-e921-4d41-bc07-8ce3d44ff125'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:51 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:51 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-ec2e55b9-0985-4d96-bbf5-4210b44c71df-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-5dcba6dc-8573-4c8a-b161-46ea4ab5a362-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Lock "cinder-ec2e55b9-0985-4d96-bbf5-4210b44c71df-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-5dcba6dc-8573-4c8a-b161-46ea4ab5a362-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-quobyte-ec2e55b9-0985-4d96-bbf5-4210b44c71df" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-5dcba6dc-8573-4c8a-b161-46ea4ab5a362" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-5dcba6dc-8573-4c8a-b161-46ea4ab5a362" acquired by "delete_volume" :: waited 0.053s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:52 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:52 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-ec2e55b9-0985-4d96-bbf5-4210b44c71df" acquired by "delete_volume" :: waited 0.086s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:52 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a0e5e-e527-467c-b925-fd7d86ff7952]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5487155-a155-4b35-94af-3b196a9fe735 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a" returned: 0 in 0.473s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a is being set with open permissions: ugo+rw Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae7ccb3-4355-42dc-bc45-24e67b01e64d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.396s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:52 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a Sep 01 02:20:52 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleted volume successfully. Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b76eff06-9a32-4494-a336-4bd2508cf401 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-7e07d665-c606-493a-ba19-64f68a3119f9-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:52 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 Sep 01 02:20:52 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df Sep 01 02:20:52 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.281s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Deleted volume successfully. Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-83addd96-250a-4ad4-aa6f-3d5b469d83ae tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-ea6ca11a-d6cd-4db7-88cd-019555dea61b-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:52 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a" returned: 0 in 0.328s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info Sep 01 02:20:52 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df" returned: 0 in 0.408s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df Sep 01 02:20:52 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362" returned: 0 in 0.494s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362 Sep 01 02:20:52 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info is being set with open permissions: ugo+rw Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:52 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info Sep 01 02:20:52 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:52 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ec2e55b9-0985-4d96-bbf5-4210b44c71df" returned: 0 in 0.294s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-ec2e55b9-0985-4d96-bbf5-4210b44c71df" released by "delete_volume" :: held 0.769s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-5dcba6dc-8573-4c8a-b161-46ea4ab5a362" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-5dcba6dc-8573-4c8a-b161-46ea4ab5a362" released by "delete_volume" :: held 0.811s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Created reservations ['c7271b79-98ba-481f-a54a-ce33e84790a8', '57a11fbb-6e82-4e1b-8ed3-4cc678a1b0d4', '11e84d87-ef02-49f5-bd4d-21301c4034f9', '81925f7d-4d64-41ea-abed-9f7152821d4a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:52 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['6bb4b789-0768-4187-a9ee-82165c35e2e7', '123c5817-9862-4b31-b0db-2720c52faffb', '7b5d4e53-f11b-4bae-8ad2-f361d56f8331', 'ab0cbce5-5668-4215-bf2b-c9ae714889e9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:52 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.info" returned: 0 in 0.283s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-309624a6-b5ee-460e-aa20-8da2723f610a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e15acb76-dac6-4682-830c-c9e688201acb tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:20:53 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:53 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-309624a6-b5ee-460e-aa20-8da2723f610a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-quobyte-309624a6-b5ee-460e-aa20-8da2723f610a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:53 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-309624a6-b5ee-460e-aa20-8da2723f610a" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6e484-395e-437f-90c2-a97c6a43aa5d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-ac74f514-d80d-44b9-998f-9dd0c823c362-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-ac74f514-d80d-44b9-998f-9dd0c823c362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-ac74f514-d80d-44b9-998f-9dd0c823c362" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-ac74f514-d80d-44b9-998f-9dd0c823c362" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleting offline snapshot ac74f514-d80d-44b9-998f-9dd0c823c362 of volume 14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] snapshot_file for this snap is: volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d1c80e-4176-486c-81e3-13b443d8ae40]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:53 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a Sep 01 02:20:53 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:53 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.451s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Deleted volume successfully. Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-38909f8e-5d1d-41fe-bc1f-d5aa84cd25c4 tempest-ProjectReaderTests-714298595 None] Lock "cinder-ec2e55b9-0985-4d96-bbf5-4210b44c71df-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:53 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 Sep 01 02:20:53 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:53 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.471s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleted volume successfully. Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8290163c-4dc7-419f-8bf9-42c5b0e2664d tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-5dcba6dc-8573-4c8a-b161-46ea4ab5a362-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-a2174044-8d5e-4532-8e7b-9cc491ac721a-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Lock "cinder-a2174044-8d5e-4532-8e7b-9cc491ac721a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-b5487155-a155-4b35-94af-3b196a9fe735" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b5487155-a155-4b35-94af-3b196a9fe735" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-a2174044-8d5e-4532-8e7b-9cc491ac721a" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-a2174044-8d5e-4532-8e7b-9cc491ac721a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot a2174044-8d5e-4532-8e7b-9cc491ac721a of volume b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c7eba3-d03e-4a57-b18d-9026db731a9e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:53 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:53 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a" returned: 0 in 0.667s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362" returned: 0 in 0.530s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:20:53 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a Sep 01 02:20:53 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e36111-6a30-4c37-8133-abfa9b5f0a06]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (1b278b4a-ff12-4754-afef-4f6aff31c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:54 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a Sep 01 02:20:54 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d219eb7c-58e2-4e3e-961d-e8b80031f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d219eb7c-58e2-4e3e-961d-e8b80031f244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862474569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595a7fbd-7088-494c-97c2-bfb9c5812b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:54Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ceabc6-64b4-4d58-9c1c-aca7c5418e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ceabc6-64b4-4d58-9c1c-aca7c5418e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df10b03-8f93-4298-a284-aae774eaae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df10b03-8f93-4298-a284-aae774eaae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595a7fbd-7088-494c-97c2-bfb9c5812b1a', 'volume_name': 'volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ffb1d8-629e-4d32-bafb-149b64c115b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ffb1d8-629e-4d32-bafb-149b64c115b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e12653f-d53d-4d79-902c-2c516877275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Volume 595a7fbd-7088-494c-97c2-bfb9c5812b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a', 'volume_size': 1} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862474569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595a7fbd-7088-494c-97c2-bfb9c5812b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:54Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Creating volume 595a7fbd-7088-494c-97c2-bfb9c5812b1a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:54 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:54 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a 1073741824 Sep 01 02:20:54 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-309624a6-b5ee-460e-aa20-8da2723f610a" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-309624a6-b5ee-460e-aa20-8da2723f610a" released by "delete_volume" :: held 1.024s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created reservations ['29c20e0b-7739-4c97-b887-ade47cdc134e', 'e3b32c1d-efdb-4118-944d-0a5fbce2750d', 'cb2409ae-9e37-4a9b-98c3-3081036f018b', '18293e30-9c23-4f27-b9a6-6d688b21a339'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:54 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a" returned: 0 in 0.441s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5487155-a155-4b35-94af-3b196a9fe735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[64504bdb-cea1-4bb7-b8f6-3ccfe60a9fd4]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" returned: 0 in 0.484s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:54 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 Sep 01 02:20:54 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 Sep 01 02:20:54 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a 1073741824" returned: 0 in 0.618s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.332s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Deleted volume successfully. Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-408ce35c-144d-400c-a540-fa1f7a453857 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-309624a6-b5ee-460e-aa20-8da2723f610a-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:54 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a Sep 01 02:20:54 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735" returned: 0 in 0.459s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a Sep 01 02:20:54 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:55 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362 Sep 01 02:20:55 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:55 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a" returned: 0 in 0.297s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e12653f-d53d-4d79-902c-2c516877275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa564f80-ab0e-4444-8066-4c20d36af7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:55 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Volume volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a (595a7fbd-7088-494c-97c2-bfb9c5812b1a): created successfully Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa564f80-ab0e-4444-8066-4c20d36af7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (1b278b4a-ff12-4754-afef-4f6aff31c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9aed0523-64d6-47c7-97a5-5d9c16f089ad tempest-ProjectReaderTests-714298595 None] Created volume successfully. Sep 01 02:20:55 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f.ac74f514-d80d-44b9-998f-9dd0c823c362" returned: 0 in 0.268s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:55 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a" returned: 0 in 0.388s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:55 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a Sep 01 02:20:55 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-ac74f514-d80d-44b9-998f-9dd0c823c362" released by "_delete_snapshot" :: held 1.965s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" released by "delete_snapshot" :: held 1.995s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-a88b58cc-659a-4af4-874d-7499c98b8311-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['37340184-d464-43cf-bf02-4871758afa41', 'd68bf86a-bc07-4969-98ab-73e7ad00b4f5', '1b22aced-c70f-474f-a625-73ea27cbf2ab', '045508ea-1d3f-492d-8efa-36f925d435d3'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-a88b58cc-659a-4af4-874d-7499c98b8311-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-quobyte-a88b58cc-659a-4af4-874d-7499c98b8311" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-a88b58cc-659a-4af4-874d-7499c98b8311" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:55 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Delete snapshot completed successfully. Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735.a2174044-8d5e-4532-8e7b-9cc491ac721a" returned: 0 in 0.296s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-4944da72-f04d-4592-9331-df305037b715 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-ac74f514-d80d-44b9-998f-9dd0c823c362-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7833ae-15db-4b80-9109-9a320c91d0d7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-a2174044-8d5e-4532-8e7b-9cc491ac721a" released by "_delete_snapshot" :: held 1.776s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b5487155-a155-4b35-94af-3b196a9fe735" released by "delete_snapshot" :: held 1.811s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "cinder-quobyte-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:55 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 Sep 01 02:20:55 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" acquired by "delete_volume" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04824f2-8e56-47a4-98d2-f9d135f1fb01]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Created reservations ['f692037c-0c3e-43d5-b4d9-d2b50faef923', 'e4261db6-72c2-4b6e-8ce5-c7fadba98ed1', 'ba3d6877-5df4-4a6d-a157-26580abea826', '90208b6c-89b1-4e47-a06e-20bc0be31409'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:20:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-954b4a41-e7f7-4b25-b8f4-b0c7d6930c1a tempest-ProjectMemberTests-481405712 None] Lock "cinder-a2174044-8d5e-4532-8e7b-9cc491ac721a-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:55 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f Sep 01 02:20:55 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-595a7fbd-7088-494c-97c2-bfb9c5812b1a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-b5487155-a155-4b35-94af-3b196a9fe735-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Lock "cinder-595a7fbd-7088-494c-97c2-bfb9c5812b1a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Lock "cinder-b5487155-a155-4b35-94af-3b196a9fe735-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:56 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311" returned: 0 in 0.500s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311 Sep 01 02:20:56 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-quobyte-595a7fbd-7088-494c-97c2-bfb9c5812b1a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-b5487155-a155-4b35-94af-3b196a9fe735" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-595a7fbd-7088-494c-97c2-bfb9c5812b1a" acquired by "delete_volume" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b5487155-a155-4b35-94af-3b196a9fe735" acquired by "delete_volume" :: waited 0.039s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[215cf752-0887-4346-b16d-3af00880b6ec]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[3907d572-fab2-42d3-ab94-d07edbc17d3b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" returned: 0 in 0.487s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f Sep 01 02:20:56 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a Sep 01 02:20:56 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 Sep 01 02:20:56 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-a88b58cc-659a-4af4-874d-7499c98b8311" returned: 0 in 0.294s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-a88b58cc-659a-4af4-874d-7499c98b8311" released by "delete_volume" :: held 0.868s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created reservations ['d4d9b8b3-0c25-4ee9-889d-d981d00ebb81', '45f2a100-e4b1-46a0-b167-000ed7da2172', '6d1db257-b897-4aeb-b19b-1196249f4ef8', '033316c8-8882-4dcc-bfad-ffd6396a9134'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:56 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" returned: 0 in 0.292s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-quobyte-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f" released by "delete_volume" :: held 0.856s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:56 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-734ab410-770f-4ae3-a77a-01ace2e4abf3-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a" returned: 0 in 0.467s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a Sep 01 02:20:56 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-734ab410-770f-4ae3-a77a-01ace2e4abf3-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Created reservations ['d6035aec-98b9-4044-a141-cc348522718a', 'dcf1950f-862f-4f59-b403-74bc18ae1cc1', '4561977f-45cd-49aa-b51d-01b02a5d619c', '77f4060f-e7a2-4224-bfae-cd63f32053fd'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:56 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735" returned: 0 in 0.573s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-quobyte-734ab410-770f-4ae3-a77a-01ace2e4abf3" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:56 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735 Sep 01 02:20:56 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-734ab410-770f-4ae3-a77a-01ace2e4abf3" acquired by "delete_volume" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[63df13c6-d53d-436c-b6ae-da478db1a2d3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:56 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:56 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:56 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-595a7fbd-7088-494c-97c2-bfb9c5812b1a" returned: 0 in 0.317s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-595a7fbd-7088-494c-97c2-bfb9c5812b1a" released by "delete_volume" :: held 0.849s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 Sep 01 02:20:57 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:57 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.479s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Deleted volume successfully. Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6e18fbec-cba6-48fb-b905-e4c435e5553f tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-a88b58cc-659a-4af4-874d-7499c98b8311-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Created reservations ['72e43956-9b6b-4598-a063-85a132980a19', '87246e1f-aa00-4187-85c3-985545de7ef7', 'd3c8b184-b1e0-4ad0-b0f2-4c06e51cdc81', '56d3b629-fa13-4aec-8f9e-c4f0c96b7af1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:57 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b5487155-a155-4b35-94af-3b196a9fe735" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b5487155-a155-4b35-94af-3b196a9fe735" released by "delete_volume" :: held 1.030s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.390s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Deleted volume successfully. Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3f849238-d10f-4e56-ada7-331d502a8127 tempest-CreateVolumesFromSnapshotTest-2019257638 None] Lock "cinder-14fe6fd3-cff8-4b23-a157-6c5d5aa5531f-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:57 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Created reservations ['c889fd06-5858-4dbb-b8d2-9328f52ae9ed', 'e6016de7-88f5-4c84-b379-7dc08ce98e1d', '91142df9-5417-4d1e-95bf-bb1bab7f0b6b', '0d9b51ef-a621-45be-ab98-348f36065fbe'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:57 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3" returned: 0 in 0.556s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:57 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3 Sep 01 02:20:57 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:57 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:57 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:57 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Deleted volume successfully. Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-29f1a59f-74fb-4561-baa4-1d1be4525e73 tempest-ProjectReaderTests-714298595 None] Lock "cinder-595a7fbd-7088-494c-97c2-bfb9c5812b1a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-734ab410-770f-4ae3-a77a-01ace2e4abf3" returned: 0 in 0.282s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-734ab410-770f-4ae3-a77a-01ace2e4abf3" released by "delete_volume" :: held 0.904s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.305s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created reservations ['e341cdb6-1916-4308-ab74-08b1e111a05b', '6e3c0795-a13c-4784-bc51-6ddbed8be09a', '0f399d66-b487-4b5c-aa45-0558cb873543', 'c205e97b-2d41-4bde-a5cb-d0ed5859e71b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d4645b8a-12a2-4bfe-97c7-ff34629fc573 tempest-ProjectMemberTests-481405712 None] Lock "cinder-b5487155-a155-4b35-94af-3b196a9fe735-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:57 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:20:57 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:58 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:58 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Deleted volume successfully. Sep 01 02:20:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d67127b7-dd64-4e0d-8f40-abb9bc99de95 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-734ab410-770f-4ae3-a77a-01ace2e4abf3-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-1585e2b2-e6d3-498c-ab90-034677589d0a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-1585e2b2-e6d3-498c-ab90-034677589d0a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-quobyte-1585e2b2-e6d3-498c-ab90-034677589d0a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (16505995-dd1b-4096-bdac-8a3f1d3b4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0d3900-92f4-4b12-8bae-f4d760933443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-1585e2b2-e6d3-498c-ab90-034677589d0a" acquired by "delete_volume" :: waited 0.075s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0d3900-92f4-4b12-8bae-f4d760933443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234464197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811051c0-7a7e-40a6-9621-38fe21a65726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:59Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e03b0c-3740-49df-9eec-793472bb002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e03b0c-3740-49df-9eec-793472bb002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b17a074-04e4-497c-8b0e-a270a5552629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b17a074-04e4-497c-8b0e-a270a5552629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811051c0-7a7e-40a6-9621-38fe21a65726', 'volume_name': 'volume-811051c0-7a7e-40a6-9621-38fe21a65726', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4993050b-1c58-469e-82f4-1f7ed1eea0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4993050b-1c58-469e-82f4-1f7ed1eea0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b994ce5a-3299-4b87-907d-8d6b041ab426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Volume 811051c0-7a7e-40a6-9621-38fe21a65726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811051c0-7a7e-40a6-9621-38fe21a65726', 'volume_size': 1} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234464197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811051c0-7a7e-40a6-9621-38fe21a65726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92b1e8e4a6b43598bbea287f6b78216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:59Z,use_quota=True,user_id='30a5c16b5fbf426498b240c366ccd49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Creating volume 811051c0-7a7e-40a6-9621-38fe21a65726 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:59 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe982ba-78f0-4ea4-a617-dda8f6af0e6d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:59 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 1073741824 Sep 01 02:20:59 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (75267956-01e1-48df-8f31-9f32ed54c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4dfb0f-3140-452d-a80f-c2cdb5e96950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4dfb0f-3140-452d-a80f-c2cdb5e96950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-750707916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c054e35-8b69-4219-82ba-65cdef699532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:59Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4037ef-e0bd-4a86-a797-aab183d13b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4037ef-e0bd-4a86-a797-aab183d13b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078621ce-3cb5-4979-aa3f-ce46076a4547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078621ce-3cb5-4979-aa3f-ce46076a4547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c054e35-8b69-4219-82ba-65cdef699532', 'volume_name': 'volume-1c054e35-8b69-4219-82ba-65cdef699532', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a5336a-9a6d-43b6-aea8-60735075dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a5336a-9a6d-43b6-aea8-60735075dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99cd4f7-5e73-4061-a44a-287761ec793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:59 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Volume 1c054e35-8b69-4219-82ba-65cdef699532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c054e35-8b69-4219-82ba-65cdef699532', 'volume_size': 1} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:59 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a Sep 01 02:20:59 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:59 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a" returned: 0 in 0.607s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:59 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a Sep 01 02:20:59 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:59 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 1073741824" returned: 0 in 0.692s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 Sep 01 02:21:00 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:00 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1585e2b2-e6d3-498c-ab90-034677589d0a" returned: 0 in 0.293s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-1585e2b2-e6d3-498c-ab90-034677589d0a" released by "delete_volume" :: held 1.048s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created reservations ['2ada13e6-60ea-433f-8b3a-dd5b930a5cd7', '9fef4921-200d-4a32-83aa-70866bd46bb9', 'bd3c1387-3197-4d28-bb56-d878432cbdca', 'e6006087-ce0a-4d0a-ac15-8ffb65c6e2d7'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:00 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726" returned: 0 in 0.289s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-750707916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c054e35-8b69-4219-82ba-65cdef699532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:59Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Creating volume 1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:00 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b994ce5a-3299-4b87-907d-8d6b041ab426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811051c0-7a7e-40a6-9621-38fe21a65726', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:00 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 1073741824 Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0ed5a5-3bc2-4fea-a2d0-167628d5074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:00 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Volume volume-811051c0-7a7e-40a6-9621-38fe21a65726 (811051c0-7a7e-40a6-9621-38fe21a65726): created successfully Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0ed5a5-3bc2-4fea-a2d0-167628d5074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Flow 'volume_create_manager' (16505995-dd1b-4096-bdac-8a3f1d3b4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-49a62922-bef1-4a81-b159-612d4e1dcb46 tempest-ProjectReaderTests-714298595 None] Created volume successfully. Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:00 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:00 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.306s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Deleted volume successfully. Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2f25ac7c-d7a7-4d31-b332-d63e2b34c4bc tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-1585e2b2-e6d3-498c-ab90-034677589d0a-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:00 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 1073741824" returned: 0 in 0.531s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 Sep 01 02:21:00 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-811051c0-7a7e-40a6-9621-38fe21a65726-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Lock "cinder-811051c0-7a7e-40a6-9621-38fe21a65726-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Acquiring lock "cinder-quobyte-811051c0-7a7e-40a6-9621-38fe21a65726" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-811051c0-7a7e-40a6-9621-38fe21a65726" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:01 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532" returned: 0 in 0.313s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99cd4f7-5e73-4061-a44a-287761ec793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c054e35-8b69-4219-82ba-65cdef699532', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d7c71b-e8a5-445e-b0b7-1517dda2f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b6846a-3d1d-41a9-8a31-089f0fe231d7]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Volume volume-1c054e35-8b69-4219-82ba-65cdef699532 (1c054e35-8b69-4219-82ba-65cdef699532): created successfully Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d7c71b-e8a5-445e-b0b7-1517dda2f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (75267956-01e1-48df-8f31-9f32ed54c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ca651b45-a526-449f-93ad-c5f2ef35dd0e tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:01 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "cinder-quobyte-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:01 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a221e05-5c9f-4d21-8f4a-6accb30487a1]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e Sep 01 02:21:01 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726 Sep 01 02:21:01 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e" returned: 0 in 0.398s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e Sep 01 02:21:01 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-811051c0-7a7e-40a6-9621-38fe21a65726" returned: 0 in 0.303s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Lock "cinder-quobyte-811051c0-7a7e-40a6-9621-38fe21a65726" released by "delete_volume" :: held 0.827s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Created reservations ['dcb6f90d-1276-4e23-a35e-26ab96ab9e5f', 'c2bbf41b-62cb-42b6-938c-5c9233b7a766', '1c8c9dde-71a8-4aef-a908-24530507f42b', 'c3708ef9-b30d-4bc3-bbee-3b20090aa72b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:02 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e" returned: 0 in 0.317s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-quobyte-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e" released by "delete_volume" :: held 0.771s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:02 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:02 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Created reservations ['e9874988-a8f4-4430-bd37-3329b95fe675', '86d21368-47ab-4d4f-8a15-a7b9795eabe2', 'a27426a4-c9c0-42c7-b1ed-07665bad0f57', 'c73fb1f4-b7fe-4f41-afb7-c5483567ad1d'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:02 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:02 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 12bdac42-24e4-41fe-902a-62b5b009c3d1 of volume 1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2272049b-5cd9-4264-9bec-b6342a678c06]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:02 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.403s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Deleted volume successfully. Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-41e10fd2-82f0-40b0-9c6b-6e64b0c598e8 tempest-ProjectReaderTests-714298595 None] Lock "cinder-811051c0-7a7e-40a6-9621-38fe21a65726-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:02 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 Sep 01 02:21:02 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:02 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.324s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:02 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Deleted volume successfully. Sep 01 02:21:02 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a743bc5a-ac72-498b-bcb0-64a15220f403 tempest-CreateVolumesFromSourceVolumeTest-168077030 None] Lock "cinder-8bace0c8-d61b-4ce2-8cb2-e8ef1c38a55e-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:03 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532" returned: 0 in 0.503s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:03 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 1G Sep 01 02:21:03 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:03 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 1G" returned: 0 in 0.499s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c054e35-8b69-4219-82ba-65cdef699532 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:03 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c054e35-8b69-4219-82ba-65cdef699532 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 Sep 01 02:21:03 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:04 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c054e35-8b69-4219-82ba-65cdef699532 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1" returned: 0 in 0.486s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:04 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 is being set with open permissions: ugo+rw Sep 01 02:21:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:04 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 Sep 01 02:21:04 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:04 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1" returned: 0 in 0.401s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:04 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info Sep 01 02:21:04 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:04 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info" returned: 0 in 0.393s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:04 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info is being set with open permissions: ugo+rw Sep 01 02:21:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:04 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info Sep 01 02:21:04 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:05 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.info" returned: 0 in 0.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-191ae04a-b213-4d7b-837c-e18762549b08 tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Flow 'volume_create_manager' (a57023f0-b6a6-4138-b7d2-c5efe22d515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97226b09-96b9-48cd-b407-106ee0c43825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97226b09-96b9-48cd-b407-106ee0c43825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae46ba27-038c-4c47-934f-81a52d27c5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e059e6ee4af74401b4c2217eaf76d924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:05Z,use_quota=True,user_id='172cea037b9049468ed091ba3e226b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a448ee1-191e-4a9d-8915-dfd9737903a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a448ee1-191e-4a9d-8915-dfd9737903a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bb863c-c8d5-4f1c-bbb5-ab2b32dfdfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.image.glance [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Creating Keystone auth plugin from conf {{(pid=87404) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-12bdac42-24e4-41fe-902a-62b5b009c3d1-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Lock "cinder-12bdac42-24e4-41fe-902a-62b5b009c3d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-1c054e35-8b69-4219-82ba-65cdef699532" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-1c054e35-8b69-4219-82ba-65cdef699532" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-12bdac42-24e4-41fe-902a-62b5b009c3d1" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-12bdac42-24e4-41fe-902a-62b5b009c3d1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 12bdac42-24e4-41fe-902a-62b5b009c3d1 of volume 1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79b07ee-c2a0-4085-a1dc-a34fae6f8956]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bb863c-c8d5-4f1c-bbb5-ab2b32dfdfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae46ba27-038c-4c47-934f-81a52d27c5c7', 'volume_name': 'volume-ae46ba27-038c-4c47-934f-81a52d27c5c7', 'volume_size': 1, 'image_id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d87af63-c26f-400b-ab0c-a304538b36d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f55b189cd1dd04d6549659b6ed6752e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e059e6ee4af74401b4c2217eaf76d924', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fec5cb6c54ef3f38b16ddc4e9496023e8c5abb0ad04acb8c0e35c7faad0e56d80e52820d8765a2cdb42b7d1cb5201e34203ac52f78217ee016217bdc59641de', 'id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'created_at': datetime.datetime(2026, 9, 1, 0, 21, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 21, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d87af63-c26f-400b-ab0c-a304538b36d7/file', 'properties': {}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:05 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 Sep 01 02:21:05 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01aaa74-9430-43d8-a211-9b7531d66c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01aaa74-9430-43d8-a211-9b7531d66c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40ce6de-d267-43f6-ac9f-36735579ee7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:05 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Volume ae46ba27-038c-4c47-934f-81a52d27c5c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae46ba27-038c-4c47-934f-81a52d27c5c7', 'volume_size': 1, 'image_id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d87af63-c26f-400b-ab0c-a304538b36d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f55b189cd1dd04d6549659b6ed6752e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e059e6ee4af74401b4c2217eaf76d924', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fec5cb6c54ef3f38b16ddc4e9496023e8c5abb0ad04acb8c0e35c7faad0e56d80e52820d8765a2cdb42b7d1cb5201e34203ac52f78217ee016217bdc59641de', 'id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'created_at': datetime.datetime(2026, 9, 1, 0, 21, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 21, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d87af63-c26f-400b-ab0c-a304538b36d7/file', 'properties': {}}, 'image_service': } Sep 01 02:21:05 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Trying to clone ae46ba27-038c-4c47-934f-81a52d27c5c7 from image 7d87af63-c26f-400b-ab0c-a304538b36d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d87af63-c26f-400b-ab0c-a304538b36d7', 'metadata': {}}]). {{(pid=87404) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:21:06 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea585fe-b74e-4360-ab9f-15298a3332fa]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:06 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1" returned: 0 in 0.522s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c054e35-8b69-4219-82ba-65cdef699532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:06 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD Sep 01 02:21:06 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00baa4a-f142-44b5-856c-f625ef786b5f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:06 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 Sep 01 02:21:06 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:06 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:06 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD Sep 01 02:21:06 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:06 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532" returned: 0 in 0.463s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:06 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 Sep 01 02:21:06 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:07 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Temporary image 7d87af63-c26f-400b-ab0c-a304538b36d7 is fetched for user 172cea037b9049468ed091ba3e226b54. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[306fd6c0-3feb-42c9-876c-1c3e7551a44e]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:07 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1" returned: 0 in 0.442s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:07 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1 Sep 01 02:21:07 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:07 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD Sep 01 02:21:07 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:07 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:07 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532.12bdac42-24e4-41fe-902a-62b5b009c3d1" returned: 0 in 0.398s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Flow 'volume_create_manager' (c83e5186-8a4e-4a72-8d8b-17f128222936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bfa5b0-a4f9-4984-9a4f-02af0daa1fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bfa5b0-a4f9-4984-9a4f-02af0daa1fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1727340623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa60168-12e2-4019-8620-0fd0d108afcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac42199b3fb4570a7e1af28e0dc2e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:08Z,use_quota=True,user_id='e726076dcbce46169ee0d02efe89d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a097eab-0d86-43cb-9fae-d6d573723b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a097eab-0d86-43cb-9fae-d6d573723b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabe75e0-aa6c-4bfa-ad6e-a40f7ebb97d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabe75e0-aa6c-4bfa-ad6e-a40f7ebb97d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa60168-12e2-4019-8620-0fd0d108afcb', 'volume_name': 'volume-6aa60168-12e2-4019-8620-0fd0d108afcb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875e2a2e-5cc7-4f93-a9b1-6ec1dca9cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:07 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD Sep 01 02:21:07 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875e2a2e-5cc7-4f93-a9b1-6ec1dca9cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e017c66-ed57-4283-81fd-62b62ed5537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:07 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Volume 6aa60168-12e2-4019-8620-0fd0d108afcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa60168-12e2-4019-8620-0fd0d108afcb', 'volume_size': 1} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1727340623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa60168-12e2-4019-8620-0fd0d108afcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac42199b3fb4570a7e1af28e0dc2e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:08Z,use_quota=True,user_id='e726076dcbce46169ee0d02efe89d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Creating volume 6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:07 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:07 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb 1073741824 Sep 01 02:21:07 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-12bdac42-24e4-41fe-902a-62b5b009c3d1" released by "_delete_snapshot" :: held 2.124s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-1c054e35-8b69-4219-82ba-65cdef699532" released by "delete_snapshot" :: held 2.158s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Created reservations ['e2d38464-59ad-4406-aee3-e62177646328', '60891be3-9019-441e-be97-8693315e8012', '2e79b976-bcca-43e3-9161-a01897973056', '7b7588aa-cbca-4b83-8dff-325ae00721a6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3e25bcc2-75e4-4859-807e-ae07aa202d77 tempest-ProjectMemberTests-481405712 None] Lock "cinder-12bdac42-24e4-41fe-902a-62b5b009c3d1-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:08 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:08 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb 1073741824" returned: 0 in 0.513s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:08 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb Sep 01 02:21:08 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:08 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb" returned: 0 in 0.280s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae46ba27-038c-4c47-934f-81a52d27c5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e059e6ee4af74401b4c2217eaf76d924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:05Z,use_quota=True,user_id='172cea037b9049468ed091ba3e226b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Creating volume ae46ba27-038c-4c47-934f-81a52d27c5c7 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:08 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:08 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 1073741824 Sep 01 02:21:08 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e017c66-ed57-4283-81fd-62b62ed5537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa60168-12e2-4019-8620-0fd0d108afcb', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5a8a98-02cb-491c-9586-bfd1a4f0b46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:08 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Volume volume-6aa60168-12e2-4019-8620-0fd0d108afcb (6aa60168-12e2-4019-8620-0fd0d108afcb): created successfully Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5a8a98-02cb-491c-9586-bfd1a4f0b46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Flow 'volume_create_manager' (c83e5186-8a4e-4a72-8d8b-17f128222936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:08 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-55e63fd9-5026-4ccd-8d77-8b80f204510e tempest-VolumeDependencyTests-1696118078 None] Created volume successfully. Sep 01 02:21:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-1c054e35-8b69-4219-82ba-65cdef699532-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-1c054e35-8b69-4219-82ba-65cdef699532-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-1c054e35-8b69-4219-82ba-65cdef699532" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-1c054e35-8b69-4219-82ba-65cdef699532" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[60492f30-8b28-4820-bf7a-16e3f6908422]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:09 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 1073741824" returned: 0 in 0.516s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:09 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 Sep 01 02:21:09 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:09 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 Sep 01 02:21:09 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:09 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7" returned: 0 in 0.282s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:09 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532" returned: 0 in 0.420s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Attempting download of 7d87af63-c26f-400b-ab0c-a304538b36d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d87af63-c26f-400b-ab0c-a304538b36d7', 'metadata': {}}])) to volume ae46ba27-038c-4c47-934f-81a52d27c5c7. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:09 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532 Sep 01 02:21:09 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9767d-5486-456d-9463-1a627e4192e6]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:09 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp Sep 01 02:21:09 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:09 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-1c054e35-8b69-4219-82ba-65cdef699532" returned: 0 in 0.340s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-1c054e35-8b69-4219-82ba-65cdef699532" released by "delete_volume" :: held 0.838s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:09 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Created reservations ['98fc5ae8-2b56-4bdd-b59f-aa1aedbf55e9', 'a1415484-7d04-47e7-8862-c11b9d3cc4a1', 'b5dd7291-4b2c-4984-82a9-57cae027ffb8', 'acfa809b-1449-4d5f-b7fe-6d7526774c9e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:10 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp" returned: 0 in 0.494s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Creating offline snapshot 25d916bf-7a8d-40f3-908b-86215f5f3ec4 of volume 6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[982cdf66-18db-4f04-a319-2e95e4d5a168]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:10 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp Sep 01 02:21:10 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb Sep 01 02:21:10 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.359s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:10 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c7f22e68-0677-450a-820f-5f7119b44fb2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-1c054e35-8b69-4219-82ba-65cdef699532-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:10 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp" returned: 1 in 0.654s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d87af63-c26f-400b-ab0c-a304538b36d7_rox2_fhp' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f78fd1a-008e-4535-bcdb-6918b3205214]: (4, 'raw') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (3e37c53e-f383-495f-8fc2-c38b9f98d4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba9193b-8d9d-47bb-b471-0fdda57bc94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:10 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb" returned: 0 in 0.721s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD Sep 01 02:21:10 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 1G Sep 01 02:21:10 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba9193b-8d9d-47bb-b471-0fdda57bc94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484073998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c86234-a0b2-431a-9f04-bb6ec750180e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:11Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f466e0-607a-4ad6-acb6-f6f32dce4186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f466e0-607a-4ad6-acb6-f6f32dce4186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91fd8f1-8ad4-4279-9e7a-415a683f69ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91fd8f1-8ad4-4279-9e7a-415a683f69ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c86234-a0b2-431a-9f04-bb6ec750180e', 'volume_name': 'volume-b6c86234-a0b2-431a-9f04-bb6ec750180e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f1d2c8-01e6-4899-9a54-261651b2cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f1d2c8-01e6-4899-9a54-261651b2cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868ec87e-83e3-4eb8-8081-83d8985afbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:10 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Volume b6c86234-a0b2-431a-9f04-bb6ec750180e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c86234-a0b2-431a-9f04-bb6ec750180e', 'volume_size': 1} Sep 01 02:21:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:11 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:11 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD Sep 01 02:21:11 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:11 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 1G" returned: 0 in 0.502s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa60168-12e2-4019-8620-0fd0d108afcb -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:11 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa60168-12e2-4019-8620-0fd0d108afcb -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 Sep 01 02:21:11 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:11 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] 7d87af63-c26f-400b-ab0c-a304538b36d7 was raw, converting to qcow2 {{(pid=87404) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:11 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 Sep 01 02:21:11 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:11 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa60168-12e2-4019-8620-0fd0d108afcb -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4" returned: 0 in 0.362s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:11 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 is being set with open permissions: ugo+rw Sep 01 02:21:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:11 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 Sep 01 02:21:11 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4" returned: 0 in 0.322s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=324,cinder:SELECT=218,cinder:DELETE=29,cinder:INSERT=80 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info Sep 01 02:21:12 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7" returned: 0 in 0.581s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d87af63-c26f-400b-ab0c-a304538b36d7_mmvzpcn8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:21:12 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 1G Sep 01 02:21:12 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info" returned: 0 in 0.312s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info is being set with open permissions: ugo+rw Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info Sep 01 02:21:12 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 1G" returned: 0 in 0.455s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Downloaded image 7d87af63-c26f-400b-ab0c-a304538b36d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d87af63-c26f-400b-ab0c-a304538b36d7', 'metadata': {}}])) to volume ae46ba27-038c-4c47-934f-81a52d27c5c7 successfully. {{(pid=87404) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Temporary image 7d87af63-c26f-400b-ab0c-a304538b36d7 for user 172cea037b9049468ed091ba3e226b54 is deleted. {{(pid=87404) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.volume_utils [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Marking volume ae46ba27-038c-4c47-934f-81a52d27c5c7 as bootable. {{(pid=87404) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Copying metadata from image 7d87af63-c26f-400b-ab0c-a304538b36d7 to ae46ba27-038c-4c47-934f-81a52d27c5c7. {{(pid=87404) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Creating volume glance metadata for volume ae46ba27-038c-4c47-934f-81a52d27c5c7 backed by image 7d87af63-c26f-400b-ab0c-a304538b36d7 with: {'image_id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0f55b189cd1dd04d6549659b6ed6752e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87404) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=247,cinder:UPDATE=321,cinder:INSERT=84,cinder:DELETE=28 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40ce6de-d267-43f6-ac9f-36735579ee7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae46ba27-038c-4c47-934f-81a52d27c5c7', 'volume_size': 1, 'image_id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d87af63-c26f-400b-ab0c-a304538b36d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f55b189cd1dd04d6549659b6ed6752e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e059e6ee4af74401b4c2217eaf76d924', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fec5cb6c54ef3f38b16ddc4e9496023e8c5abb0ad04acb8c0e35c7faad0e56d80e52820d8765a2cdb42b7d1cb5201e34203ac52f78217ee016217bdc59641de', 'id': '7d87af63-c26f-400b-ab0c-a304538b36d7', 'created_at': datetime.datetime(2026, 9, 1, 0, 21, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 21, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d87af63-c26f-400b-ab0c-a304538b36d7/file', 'properties': {}}, 'image_service': }' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28dfb6f4-ad8e-4e9e-bd33-b1c8af897b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Volume volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 (ae46ba27-038c-4c47-934f-81a52d27c5c7): created successfully Sep 01 02:21:12 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28dfb6f4-ad8e-4e9e-bd33-b1c8af897b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Flow 'volume_create_manager' (a57023f0-b6a6-4138-b7d2-c5efe22d515e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.info" returned: 0 in 0.371s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.760s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484073998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c86234-a0b2-431a-9f04-bb6ec750180e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:11Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Creating volume b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:12 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e 1073741824 Sep 01 02:21:12 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a1d5ae04-dd38-4f9c-b4aa-d26ac1d60246 tempest-VolumeImageDependencyTests-2056269133 None] Created volume successfully. Sep 01 02:21:12 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-442a8927-98c1-41ab-8cc2-14a3e6adb307 tempest-VolumeDependencyTests-1696118078 None] Create snapshot completed successfully Sep 01 02:21:13 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e 1073741824" returned: 0 in 0.508s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:13 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e Sep 01 02:21:13 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:13 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e" returned: 0 in 0.338s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868ec87e-83e3-4eb8-8081-83d8985afbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c86234-a0b2-431a-9f04-bb6ec750180e', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f5d3aa-dcf3-41e7-a1c2-2ad13b1bf97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Volume volume-b6c86234-a0b2-431a-9f04-bb6ec750180e (b6c86234-a0b2-431a-9f04-bb6ec750180e): created successfully Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f5d3aa-dcf3-41e7-a1c2-2ad13b1bf97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (3e37c53e-f383-495f-8fc2-c38b9f98d4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:13 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-37760ba8-b59a-47a4-b692-e848c77c48d3 tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Flow 'volume_create_manager' (edd227f9-ee43-4463-bc45-812395e48ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5bfc3b-d378-4235-bba4-368f9e7d645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5bfc3b-d378-4235-bba4-368f9e7d645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1456865670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d27892-df83-4ad5-9cc6-75b4b5da1aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac42199b3fb4570a7e1af28e0dc2e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25d916bf-7a8d-40f3-908b-86215f5f3ec4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:14Z,use_quota=True,user_id='e726076dcbce46169ee0d02efe89d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b0acfe-7466-4f8e-af6f-e6247332aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b0acfe-7466-4f8e-af6f-e6247332aec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a0dcaa-6fd4-4d6c-b3c8-28e27fcc7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a0dcaa-6fd4-4d6c-b3c8-28e27fcc7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85d27892-df83-4ad5-9cc6-75b4b5da1aa1', 'volume_name': 'volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1', 'volume_size': 1, 'snapshot_id': '25d916bf-7a8d-40f3-908b-86215f5f3ec4'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cae26a4-72aa-4385-857d-c4717c5cc0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cae26a4-72aa-4385-857d-c4717c5cc0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9681e78f-fb2e-4a3d-9848-b9aaa37e9c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Volume 85d27892-df83-4ad5-9cc6-75b4b5da1aa1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1', 'volume_size': 1, 'snapshot_id': '25d916bf-7a8d-40f3-908b-86215f5f3ec4'} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-quobyte-25d916bf-7a8d-40f3-908b-86215f5f3ec4-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-25d916bf-7a8d-40f3-908b-86215f5f3ec4-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Creating volume 85d27892-df83-4ad5-9cc6-75b4b5da1aa1 from snapshot 25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-quobyte-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] snapshot: 25d916bf-7a8d-40f3-908b-86215f5f3ec4, volume: 85d27892-df83-4ad5-9cc6-75b4b5da1aa1, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Acquiring lock "cinder-ae46ba27-038c-4c47-934f-81a52d27c5c7-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[feab70bf-4990-4416-9187-7ded8c901787]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Lock "cinder-ae46ba27-038c-4c47-934f-81a52d27c5c7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Acquiring lock "cinder-quobyte-ae46ba27-038c-4c47-934f-81a52d27c5c7" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Lock "cinder-quobyte-ae46ba27-038c-4c47-934f-81a52d27c5c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[74487227-c7aa-4604-9148-b08d1a239a47]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 Sep 01 02:21:14 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 Sep 01 02:21:14 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:14 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4" returned: 0 in 0.512s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa60168-12e2-4019-8620-0fd0d108afcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c0bdf6-0ddd-4dc5-a858-7554a9f8c359]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7" returned: 0 in 0.464s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7 Sep 01 02:21:14 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb Sep 01 02:21:14 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:15 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ae46ba27-038c-4c47-934f-81a52d27c5c7" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Lock "cinder-quobyte-ae46ba27-038c-4c47-934f-81a52d27c5c7" released by "delete_volume" :: held 0.865s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:15 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb" returned: 0 in 0.437s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:15 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 Sep 01 02:21:15 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Created reservations ['d39ac0b0-568d-4be7-925d-4abe0810c1d1', 'e4d8f535-d079-4e74-8715-bda7bc20db61', '8ae1b32b-0353-40f0-a513-6aa1be42a563', '2d532466-6a5a-4c40-997d-1ed1b59e4e16'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:15 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:15 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:15 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.399s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:15 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Deleted volume successfully. Sep 01 02:21:15 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-32d65905-68a7-4aef-9581-209ab466f050 tempest-VolumeImageDependencyTests-2056269133 None] Lock "cinder-ae46ba27-038c-4c47-934f-81a52d27c5c7-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:20 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" returned: 0 in 5.889s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:21:21 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Converted 1024.00 MB image at 173.85 MB/s Sep 01 02:21:21 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 is being set with open permissions: ugo+rw Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:21 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 Sep 01 02:21:21 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:21 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" returned: 0 in 0.297s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" released by "_copy_volume_from_snapshot" :: held 7.260s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-25d916bf-7a8d-40f3-908b-86215f5f3ec4-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" released by "_create_volume_from_snapshot" :: held 7.338s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.359s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.822s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 of volume b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9681e78f-fb2e-4a3d-9848-b9aaa37e9c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1', 'volume_size': 1, 'snapshot_id': '25d916bf-7a8d-40f3-908b-86215f5f3ec4'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d660313b-2d07-4234-a07e-c9e0666c5b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26a62a-ca6b-4f4f-8fb5-e56a0c794556]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:21 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Volume volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 (85d27892-df83-4ad5-9cc6-75b4b5da1aa1): created successfully Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d660313b-2d07-4234-a07e-c9e0666c5b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Flow 'volume_create_manager' (edd227f9-ee43-4463-bc45-812395e48ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0e3719cb-be51-40bd-b2f3-4e978939050f tempest-VolumeDependencyTests-1696118078 None] Created volume successfully. Sep 01 02:21:21 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e Sep 01 02:21:21 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-25d916bf-7a8d-40f3-908b-86215f5f3ec4-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-25d916bf-7a8d-40f3-908b-86215f5f3ec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-quobyte-6aa60168-12e2-4019-8620-0fd0d108afcb" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-6aa60168-12e2-4019-8620-0fd0d108afcb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-quobyte-25d916bf-7a8d-40f3-908b-86215f5f3ec4" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-25d916bf-7a8d-40f3-908b-86215f5f3ec4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Deleting offline snapshot 25d916bf-7a8d-40f3-908b-86215f5f3ec4 of volume 6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:21 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] snapshot_file for this snap is: volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e" returned: 0 in 0.550s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014964d-b927-44af-b1e8-79afe8992865]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:22 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 1G Sep 01 02:21:22 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:22 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 Sep 01 02:21:22 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:22 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4" returned: 0 in 0.532s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa60168-12e2-4019-8620-0fd0d108afcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d285f1d4-3284-4aaa-aca8-d23a82675192]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:22 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 1G" returned: 0 in 0.621s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:22 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c86234-a0b2-431a-9f04-bb6ec750180e -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:22 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c86234-a0b2-431a-9f04-bb6ec750180e -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 Sep 01 02:21:22 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:22 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb Sep 01 02:21:22 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c86234-a0b2-431a-9f04-bb6ec750180e -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" returned: 0 in 0.515s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 is being set with open permissions: ugo+rw Sep 01 02:21:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 Sep 01 02:21:23 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb" returned: 0 in 0.863s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 Sep 01 02:21:23 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" returned: 0 in 0.504s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info Sep 01 02:21:23 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:24 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info" returned: 0 in 0.380s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info is being set with open permissions: ugo+rw Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:24 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info Sep 01 02:21:24 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:24 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4" returned: 0 in 0.690s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:24 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4 Sep 01 02:21:24 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:24 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.info" returned: 0 in 0.318s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.036s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:24 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb.25d916bf-7a8d-40f3-908b-86215f5f3ec4" returned: 0 in 0.293s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-861d96b0-c464-4ee2-8ab2-b93f4228c4ad tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-25d916bf-7a8d-40f3-908b-86215f5f3ec4" released by "_delete_snapshot" :: held 2.553s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-6aa60168-12e2-4019-8620-0fd0d108afcb" released by "delete_snapshot" :: held 2.595s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Created reservations ['d8a3e2fb-fc7d-443d-b39b-8df90358bfe0', 'b13aa0c1-9211-4109-9bea-8a037869ec4e', '8e503f45-020f-4a32-901e-8ea755225ee7', '3fac1c27-5a2c-46c7-9337-d0c8a02b2360'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:24 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Delete snapshot completed successfully. Sep 01 02:21:24 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5998518c-47fb-4974-b26d-ee3c9c5bd4f4 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-25d916bf-7a8d-40f3-908b-86215f5f3ec4-delete_snapshot" released by "delete_snapshot" :: held 2.818s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-6aa60168-12e2-4019-8620-0fd0d108afcb-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-6aa60168-12e2-4019-8620-0fd0d108afcb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-quobyte-6aa60168-12e2-4019-8620-0fd0d108afcb" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-6aa60168-12e2-4019-8620-0fd0d108afcb" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa117600-cc45-43b9-8b83-ae23bf8bd1dd]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-b6c86234-a0b2-431a-9f04-bb6ec750180e" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b6c86234-a0b2-431a-9f04-bb6ec750180e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 of volume b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9384e6-2717-4d19-bc60-317902492486]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:25 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb Sep 01 02:21:25 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:25 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 Sep 01 02:21:25 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:25 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb" returned: 0 in 0.580s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:25 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb Sep 01 02:21:25 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:26 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" returned: 0 in 0.632s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6c86234-a0b2-431a-9f04-bb6ec750180e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d21db2-a6b6-491a-8292-f99216e2abd3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:26 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6aa60168-12e2-4019-8620-0fd0d108afcb" returned: 0 in 0.307s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-6aa60168-12e2-4019-8620-0fd0d108afcb" released by "delete_volume" :: held 0.975s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:26 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e Sep 01 02:21:26 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Created reservations ['fb964b66-b506-4eeb-a065-53a933ed6554', '606319d3-143e-453b-8a8d-886e594c2dc6', '77b1089a-2c6c-40fb-9cdf-25b3625b4339', '41c8aa70-112e-43f2-b5bb-e6849ed5e915'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:26 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:26 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:26 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e" returned: 0 in 0.476s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:26 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 Sep 01 02:21:26 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:26 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.291s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Deleted volume successfully. Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b6fdbeae-830a-4373-ab84-80d7c6687813 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-6aa60168-12e2-4019-8620-0fd0d108afcb-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:26 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" returned: 0 in 0.383s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:26 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23 Sep 01 02:21:26 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:27 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e.2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23" released by "_delete_snapshot" :: held 1.862s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b6c86234-a0b2-431a-9f04-bb6ec750180e" released by "delete_snapshot" :: held 1.890s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Created reservations ['80c9fe85-c0ad-40cd-83d2-59a6ce3a5ce4', 'd5cd358a-cdfc-48ff-b860-a9e03d8f1b81', '24dede5e-2f40-4cac-ab9a-cbcdec953ffe', '85a6b68a-4f2f-41d4-a4db-b8955340b89c'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:27 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-c1cde8ee-5b7e-4cb9-a904-f4159b02a6c2 tempest-ProjectMemberTests-481405712 None] Lock "cinder-2be2ddb8-a3b3-4d6e-9927-0e6eaee49c23-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-85d27892-df83-4ad5-9cc6-75b4b5da1aa1-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-85d27892-df83-4ad5-9cc6-75b4b5da1aa1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-b6c86234-a0b2-431a-9f04-bb6ec750180e-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Lock "cinder-b6c86234-a0b2-431a-9f04-bb6ec750180e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "cinder-quobyte-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f2716-e250-4148-bef5-b0d7d48066e8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-b6c86234-a0b2-431a-9f04-bb6ec750180e" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b6c86234-a0b2-431a-9f04-bb6ec750180e" acquired by "delete_volume" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7282796a-9349-4599-ba16-35d6a1dc823b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:27 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 Sep 01 02:21:27 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:27 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e Sep 01 02:21:27 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:27 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" returned: 0 in 0.401s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:28 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1 Sep 01 02:21:28 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:28 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:28 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e Sep 01 02:21:28 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:28 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-quobyte-85d27892-df83-4ad5-9cc6-75b4b5da1aa1" released by "delete_volume" :: held 0.745s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Created reservations ['2658e159-297b-401b-81d6-e26eeabb982e', '081d4513-25b0-4a2e-b7f3-77976a7a4dbb', '6351f54c-ffa2-4d42-bc9b-4a7c455dfb87', 'c0f4b2c9-7a06-4dd3-953c-9ea8e278740a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:28 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b6c86234-a0b2-431a-9f04-bb6ec750180e" returned: 0 in 0.300s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-b6c86234-a0b2-431a-9f04-bb6ec750180e" released by "delete_volume" :: held 0.781s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:28 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:28 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Created reservations ['970e5aa1-f6ea-4b58-aaf1-ca23aed4e48e', '89c177ad-103e-4f26-9476-1fcacc6e800e', '6d38f45e-f5cb-4eb9-8e7c-3595f0e6fa7c', '2a36e335-c443-415d-9670-3dddd776c2b9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:28 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:28 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:28 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:28 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:29 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.525s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:29 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Deleted volume successfully. Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.363s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:29 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:21:29 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.501s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-cfab804b-d6a4-4cd3-81ec-595753bb1260 tempest-VolumeDependencyTests-1696118078 None] Lock "cinder-85d27892-df83-4ad5-9cc6-75b4b5da1aa1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-45b24a09-9ecc-43c8-8d78-41140612ba84 tempest-ProjectMemberTests-481405712 None] Lock "cinder-b6c86234-a0b2-431a-9f04-bb6ec750180e-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (51638f71-d427-41b1-83f3-dda3fa2a0769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95df1b83-97f0-4e2e-ac75-67eb8a164da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95df1b83-97f0-4e2e-ac75-67eb8a164da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252518912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dac4f5-1ba6-4825-babe-e1ecbd07fd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:29Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a98445-ba78-4d44-b84f-0b178d2f3287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a98445-ba78-4d44-b84f-0b178d2f3287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83224291-2636-43c8-a5fa-279b1fa9ee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83224291-2636-43c8-a5fa-279b1fa9ee73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32dac4f5-1ba6-4825-babe-e1ecbd07fd89', 'volume_name': 'volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef71e760-d09a-4e7b-b876-7fb1cdd27c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef71e760-d09a-4e7b-b876-7fb1cdd27c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cc839d-ba70-4b92-8445-d3144b279c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:29 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Volume 32dac4f5-1ba6-4825-babe-e1ecbd07fd89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89', 'volume_size': 1} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252518912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dac4f5-1ba6-4825-babe-e1ecbd07fd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:29Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Creating volume 32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:29 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:29 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 1073741824 Sep 01 02:21:29 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:30 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 1073741824" returned: 0 in 0.612s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:30 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 Sep 01 02:21:30 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:30 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cc839d-ba70-4b92-8445-d3144b279c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6adc9a5-6fb8-45bf-9779-57679cea2e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:30 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Volume volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 (32dac4f5-1ba6-4825-babe-e1ecbd07fd89): created successfully Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6adc9a5-6fb8-45bf-9779-57679cea2e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:30 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (51638f71-d427-41b1-83f3-dda3fa2a0769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-53db4131-59db-4c2f-9091-e8c7c2f2d6cd tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:21:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 9d038882-dba9-4f67-b478-25bb36ed87d3 of volume 32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:31 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c3bc0b-e7cf-428a-8d43-b5820aab7cec]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:31 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 Sep 01 02:21:31 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:32 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" returned: 0 in 0.475s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:32 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 1G Sep 01 02:21:32 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:32 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 1G" returned: 0 in 0.620s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:32 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 Sep 01 02:21:32 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:33 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3" returned: 0 in 0.396s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:33 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 is being set with open permissions: ugo+rw Sep 01 02:21:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:33 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 Sep 01 02:21:33 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:33 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3" returned: 0 in 0.317s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:33 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info Sep 01 02:21:33 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:34 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info" returned: 0 in 0.475s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:34 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info is being set with open permissions: ugo+rw Sep 01 02:21:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:34 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info Sep 01 02:21:34 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:34 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.info" returned: 0 in 0.309s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.736s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:34 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-635566da-8aaf-4e6d-8da1-b01b5de575e2 tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:21:34 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-9d038882-dba9-4f67-b478-25bb36ed87d3-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-9d038882-dba9-4f67-b478-25bb36ed87d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-9d038882-dba9-4f67-b478-25bb36ed87d3" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-9d038882-dba9-4f67-b478-25bb36ed87d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 9d038882-dba9-4f67-b478-25bb36ed87d3 of volume 32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ebeb6-c928-4489-bf1c-77e3bcae916a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Flow 'volume_create_manager' (5bee6090-6613-427d-b49f-49fddc0f118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719ae16a-1b22-4a7d-a4f8-cf67b6931bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719ae16a-1b22-4a7d-a4f8-cf67b6931bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1441456810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeeef6b4-505b-4f74-abde-7cd1d1f1fec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d858dbe784dd39206f3cf2daaa580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:35Z,use_quota=True,user_id='870e41dc9b8e433793bc6aae2e4621bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3793698-5a40-4552-9f52-8bb72c6790ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3793698-5a40-4552-9f52-8bb72c6790ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecffde51-3dd3-42e3-aa0d-8bbd81280a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:35 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 Sep 01 02:21:35 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecffde51-3dd3-42e3-aa0d-8bbd81280a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeeef6b4-505b-4f74-abde-7cd1d1f1fec5', 'volume_name': 'volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da6bcac-056c-47f4-b746-707021d08553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da6bcac-056c-47f4-b746-707021d08553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b3a272-5449-4d88-a97b-1c763f935fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:35 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Volume aeeef6b4-505b-4f74-abde-7cd1d1f1fec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5', 'volume_size': 1} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1441456810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeeef6b4-505b-4f74-abde-7cd1d1f1fec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d858dbe784dd39206f3cf2daaa580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:35Z,use_quota=True,user_id='870e41dc9b8e433793bc6aae2e4621bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Creating volume aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:35 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:35 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 1073741824 Sep 01 02:21:35 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:35 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bdf8c4-d93e-49e4-890a-6ae7f00e6920]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:35 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 Sep 01 02:21:35 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:35 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 1073741824" returned: 0 in 0.505s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:35 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 Sep 01 02:21:35 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:35 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" returned: 0 in 0.431s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 Sep 01 02:21:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:36 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" returned: 0 in 0.267s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b3a272-5449-4d88-a97b-1c763f935fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc47a277-0d8e-4cb2-9451-7718144e82bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:36 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Volume volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 (aeeef6b4-505b-4f74-abde-7cd1d1f1fec5): created successfully Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc47a277-0d8e-4cb2-9451-7718144e82bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Flow 'volume_create_manager' (5bee6090-6613-427d-b49f-49fddc0f118d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-80e976c2-7585-4c11-a72d-f87f9ceeea78 tempest-SnapshotDependencyTests-265832596 None] Created volume successfully. Sep 01 02:21:36 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3" returned: 0 in 0.386s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:36 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3 Sep 01 02:21:36 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89.9d038882-dba9-4f67-b478-25bb36ed87d3" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-9d038882-dba9-4f67-b478-25bb36ed87d3" released by "_delete_snapshot" :: held 1.548s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" released by "delete_snapshot" :: held 1.576s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Created reservations ['a0427c2f-bc00-4697-8985-5be6331f806c', '16e757fa-19d3-4548-980d-0d835371a811', '4d436bad-b58f-477c-860a-4e4196f39248', '85cb2480-c432-4ba8-abf8-b7da3c07aeaa'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:36 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:21:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-97b36a78-b87e-44a4-8724-088b30218bf9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-9d038882-dba9-4f67-b478-25bb36ed87d3-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-32dac4f5-1ba6-4825-babe-e1ecbd07fd89-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Lock "cinder-32dac4f5-1ba6-4825-babe-e1ecbd07fd89-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1592d3e-69f9-4630-9da4-72738c5a6403]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:37 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 Sep 01 02:21:37 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Creating offline snapshot d86c385d-d944-4273-ad2a-5b48f4b1e761 of volume aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b2aa4-b523-4e17-9167-575209e654ee]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:37 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 Sep 01 02:21:37 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:37 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" returned: 0 in 0.405s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:37 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89 Sep 01 02:21:37 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:37 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" returned: 0 in 0.262s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:37 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" returned: 0 in 0.418s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-32dac4f5-1ba6-4825-babe-e1ecbd07fd89" released by "delete_volume" :: held 0.756s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:38 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 1G Sep 01 02:21:38 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Created reservations ['ef4c9b14-bcd0-4f75-b2f1-8bf432e062ee', '2b14b130-7b8c-4395-a41c-07d98a7fa3f3', '5508c3d0-f6a8-4ecf-af9e-703cc66743e0', 'f8b5fd3a-7579-46f8-9174-b5bd1717954a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:38 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.292s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:38 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-b51e1d77-9d2a-4e33-b4bc-01fd48022f5a tempest-ProjectMemberTests-481405712 None] Lock "cinder-32dac4f5-1ba6-4825-babe-e1ecbd07fd89-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:38 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 1G" returned: 0 in 0.516s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 Sep 01 02:21:38 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761" returned: 0 in 0.315s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:38 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 is being set with open permissions: ugo+rw Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 Sep 01 02:21:38 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (1eecfdf2-37d2-4ef8-b4ec-7a0ef61a56b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcaaff9-eabe-4473-80bf-8cc14f2e3d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcaaff9-eabe-4473-80bf-8cc14f2e3d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337869746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3695e7-6604-46fb-b9dc-8536a07fe36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:39Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6827d1-fcee-4176-817a-9d203cddcdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6827d1-fcee-4176-817a-9d203cddcdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a484847d-91ad-4f92-9fb5-5034a3ed8af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a484847d-91ad-4f92-9fb5-5034a3ed8af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3695e7-6604-46fb-b9dc-8536a07fe36a', 'volume_name': 'volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cda6d-e942-41bc-81aa-d8bf586605ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cda6d-e942-41bc-81aa-d8bf586605ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20afa85-f102-43ea-96a1-2fb3c64e548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Volume ad3695e7-6604-46fb-b9dc-8536a07fe36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a', 'volume_size': 1} Sep 01 02:21:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:39 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761" returned: 0 in 0.272s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:39 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info Sep 01 02:21:39 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:39 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info" returned: 0 in 0.269s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info is being set with open permissions: ugo+rw Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:39 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info Sep 01 02:21:39 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:39 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.info" returned: 0 in 0.284s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337869746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3695e7-6604-46fb-b9dc-8536a07fe36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:39Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Creating volume ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:39 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:39 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a 1073741824 Sep 01 02:21:39 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c43a94e6-9454-4554-bec9-ae9a1bbc14c0 tempest-SnapshotDependencyTests-265832596 None] Create snapshot completed successfully Sep 01 02:21:40 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a 1073741824" returned: 0 in 0.495s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:40 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a Sep 01 02:21:40 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:40 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a" returned: 0 in 0.232s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20afa85-f102-43ea-96a1-2fb3c64e548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d445ca-b3c6-408f-acdb-b0284643740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Volume volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a (ad3695e7-6604-46fb-b9dc-8536a07fe36a): created successfully Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d445ca-b3c6-408f-acdb-b0284643740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (1eecfdf2-37d2-4ef8-b4ec-7a0ef61a56b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-331e4e2e-a705-490e-a41b-2446f3ebf26c tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 5b64c292-738a-41ea-b531-1236bb467098 of volume ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a8180-0b47-45a1-b293-1643e10329d8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:41 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a Sep 01 02:21:41 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Flow 'volume_create_manager' (8847d512-ddcb-425e-888e-857e222931a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6d9f40-fbfa-4651-949b-55895d0f052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6d9f40-fbfa-4651-949b-55895d0f052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bedb6d-81c3-4313-a265-885c0ecdb02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d858dbe784dd39206f3cf2daaa580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d86c385d-d944-4273-ad2a-5b48f4b1e761,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='870e41dc9b8e433793bc6aae2e4621bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58240902-78d8-4370-8371-bae5601c6259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58240902-78d8-4370-8371-bae5601c6259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c4af8f-4b09-48b6-ba3b-5a965b2d368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c4af8f-4b09-48b6-ba3b-5a965b2d368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38bedb6d-81c3-4313-a265-885c0ecdb02f', 'volume_name': 'volume-38bedb6d-81c3-4313-a265-885c0ecdb02f', 'volume_size': 1, 'snapshot_id': 'd86c385d-d944-4273-ad2a-5b48f4b1e761'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41871328-433a-4857-a9a3-e75e0b07bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41871328-433a-4857-a9a3-e75e0b07bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56da36be-a7c0-4ddf-8b3c-72dff8de97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Volume 38bedb6d-81c3-4313-a265-885c0ecdb02f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38bedb6d-81c3-4313-a265-885c0ecdb02f', 'volume_size': 1, 'snapshot_id': 'd86c385d-d944-4273-ad2a-5b48f4b1e761'} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:41 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a" returned: 0 in 0.405s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 1G Sep 01 02:21:41 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 1G" returned: 0 in 0.434s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 Sep 01 02:21:42 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098" returned: 0 in 0.292s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 is being set with open permissions: ugo+rw Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 Sep 01 02:21:42 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098" returned: 0 in 0.246s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info Sep 01 02:21:42 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info is being set with open permissions: ugo+rw Sep 01 02:21:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info Sep 01 02:21:42 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:43 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.info" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.669s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-quobyte-d86c385d-d944-4273-ad2a-5b48f4b1e761-38bedb6d-81c3-4313-a265-885c0ecdb02f" by "_create_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-d86c385d-d944-4273-ad2a-5b48f4b1e761-38bedb6d-81c3-4313-a265-885c0ecdb02f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Creating volume 38bedb6d-81c3-4313-a265-885c0ecdb02f from snapshot d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-quobyte-38bedb6d-81c3-4313-a265-885c0ecdb02f" by "_copy_volume_from_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:43 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-ec0d1e80-0815-440d-bc34-ac1ae40ba6d9 tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-38bedb6d-81c3-4313-a265-885c0ecdb02f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] snapshot: d86c385d-d944-4273-ad2a-5b48f4b1e761, volume: 38bedb6d-81c3-4313-a265-885c0ecdb02f, {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e5f528-8f6d-436e-b037-56ee2c9e60ad]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:43 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 Sep 01 02:21:43 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:43 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761" returned: 0 in 0.376s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b8d66c-f22f-4653-aedf-fdc971266116]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:43 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 Sep 01 02:21:43 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" returned: 0 in 0.369s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Creating direct copy from snapshot {{(pid=87404) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.utils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Path /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f not found in is_blk_device check {{(pid=87404) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f Sep 01 02:21:44 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-5b64c292-738a-41ea-b531-1236bb467098-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-5b64c292-738a-41ea-b531-1236bb467098-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-ad3695e7-6604-46fb-b9dc-8536a07fe36a" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ad3695e7-6604-46fb-b9dc-8536a07fe36a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-5b64c292-738a-41ea-b531-1236bb467098" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-5b64c292-738a-41ea-b531-1236bb467098" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 5b64c292-738a-41ea-b531-1236bb467098 of volume ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf3eb95-cf17-46c4-901c-45c255d62223]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 Sep 01 02:21:44 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098" returned: 0 in 0.736s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:45 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd96231e-fcbd-4eb6-8b0a-a67e90009db3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a Sep 01 02:21:45 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:46 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a" returned: 0 in 0.883s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:46 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 Sep 01 02:21:46 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:46 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098" returned: 0 in 0.712s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:46 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098 Sep 01 02:21:46 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a.5b64c292-738a-41ea-b531-1236bb467098" returned: 0 in 0.438s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-5b64c292-738a-41ea-b531-1236bb467098" released by "_delete_snapshot" :: held 2.944s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ad3695e7-6604-46fb-b9dc-8536a07fe36a" released by "delete_snapshot" :: held 2.971s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Created reservations ['fc3cf3fa-19fd-4117-8c5b-d2ab15c17140', '5b170fad-2eb1-44ee-97fd-4314bb63d8b6', '46b7a94b-08da-4420-87aa-d77606b6bb89', 'e0fe4f98-db51-442e-86cb-16a84f19c574'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-69edccca-143b-4ed6-91ce-8af484903a6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-5b64c292-738a-41ea-b531-1236bb467098-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-ad3695e7-6604-46fb-b9dc-8536a07fe36a-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-ad3695e7-6604-46fb-b9dc-8536a07fe36a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-ad3695e7-6604-46fb-b9dc-8536a07fe36a" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:47 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ad3695e7-6604-46fb-b9dc-8536a07fe36a" acquired by "delete_volume" :: waited 0.041s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:48 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[23269c5f-e40e-41ea-802d-d424b9f1ef64]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:48 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a Sep 01 02:21:48 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f" returned: 0 in 4.989s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.image.image_utils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Image conversion details: src /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f {{(pid=87404) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:21:49 devstack cinder-volume[87404]: INFO cinder.image.image_utils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Converted 1024.00 MB image at 205.21 MB/s Sep 01 02:21:49 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f is being set with open permissions: ugo+rw Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f Sep 01 02:21:49 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a" returned: 0 in 1.138s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a Sep 01 02:21:49 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-38bedb6d-81c3-4313-a265-885c0ecdb02f" released by "_copy_volume_from_snapshot" :: held 6.116s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-d86c385d-d944-4273-ad2a-5b48f4b1e761-38bedb6d-81c3-4313-a265-885c0ecdb02f" released by "_create_volume_from_snapshot" :: held 6.202s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.229s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:49 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ad3695e7-6604-46fb-b9dc-8536a07fe36a" returned: 0 in 0.268s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ad3695e7-6604-46fb-b9dc-8536a07fe36a" released by "delete_volume" :: held 1.529s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56da36be-a7c0-4ddf-8b3c-72dff8de97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bedb6d-81c3-4313-a265-885c0ecdb02f', 'volume_size': 1, 'snapshot_id': 'd86c385d-d944-4273-ad2a-5b48f4b1e761'}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894c3a14-d6c6-4f39-9110-c7930598c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:49 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Volume volume-38bedb6d-81c3-4313-a265-885c0ecdb02f (38bedb6d-81c3-4313-a265-885c0ecdb02f): created successfully Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894c3a14-d6c6-4f39-9110-c7930598c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Flow 'volume_create_manager' (8847d512-ddcb-425e-888e-857e222931a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d83b1c2e-68a1-4fd5-b30d-9b40c63d1fe6 tempest-SnapshotDependencyTests-265832596 None] Created volume successfully. Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Created reservations ['a2d5f632-1ce3-48f2-9036-0ab215de83ac', '5f87bbe4-bbb2-4fd6-acc3-e05bb7e441c1', '353b26e0-9b79-4a14-8be6-2e2d3b7474a3', '22c5c6dc-8837-43ac-ba87-bca2d85ce84e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:49 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:21:49 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-82165d4b-1bf4-4a9e-bbf3-f3e93e590b6b tempest-ProjectMemberTests-481405712 None] Lock "cinder-ad3695e7-6604-46fb-b9dc-8536a07fe36a-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-d86c385d-d944-4273-ad2a-5b48f4b1e761-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-d86c385d-d944-4273-ad2a-5b48f4b1e761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-quobyte-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-quobyte-d86c385d-d944-4273-ad2a-5b48f4b1e761" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-d86c385d-d944-4273-ad2a-5b48f4b1e761" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Deleting offline snapshot d86c385d-d944-4273-ad2a-5b48f4b1e761 of volume aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] snapshot_file for this snap is: volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a3071f-30c4-4cb4-b98c-640222346f73]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 Sep 01 02:21:50 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (d08ed442-f7b0-4604-8d4a-63e1a002b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26861d8b-41b2-45db-ae86-1f9982702f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26861d8b-41b2-45db-ae86-1f9982702f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964400332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dcf063-2b0c-44bc-be87-f39fd9cf5919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:51Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097c18f4-6d83-422e-bb7b-535232093646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097c18f4-6d83-422e-bb7b-535232093646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a0c7b2-dbe3-4e28-bb2a-bd7d77d08fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a0c7b2-dbe3-4e28-bb2a-bd7d77d08fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dcf063-2b0c-44bc-be87-f39fd9cf5919', 'volume_name': 'volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecfc36a-e4d5-4aa0-b09b-6df2cbabdc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecfc36a-e4d5-4aa0-b09b-6df2cbabdc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa860be7-cf6f-4599-8db1-d117d77ec70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Volume f9dcf063-2b0c-44bc-be87-f39fd9cf5919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919', 'volume_size': 1} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964400332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dcf063-2b0c-44bc-be87-f39fd9cf5919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:51Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Creating volume f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:50 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 1073741824 Sep 01 02:21:50 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761" returned: 0 in 0.360s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[08779444-ad09-4bec-9418-9d3789436f4f]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 Sep 01 02:21:50 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 1073741824" returned: 0 in 0.484s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 Sep 01 02:21:51 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" returned: 0 in 0.608s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 Sep 01 02:21:51 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" returned: 0 in 0.310s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa860be7-cf6f-4599-8db1-d117d77ec70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efcab97-ba10-4bcc-a52f-d4777a87d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:51 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Volume volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 (f9dcf063-2b0c-44bc-be87-f39fd9cf5919): created successfully Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efcab97-ba10-4bcc-a52f-d4777a87d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (d08ed442-f7b0-4604-8d4a-63e1a002b051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-21491fb9-8a54-470f-8f38-1a6f2a6e296c tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:21:51 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761" returned: 0 in 0.385s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761 Sep 01 02:21:51 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5.d86c385d-d944-4273-ad2a-5b48f4b1e761" returned: 0 in 0.254s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-d86c385d-d944-4273-ad2a-5b48f4b1e761" released by "_delete_snapshot" :: held 1.707s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" released by "delete_snapshot" :: held 1.729s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Created reservations ['8f3c3b06-2538-4fc1-9f40-d0e28a88b52a', '90c00af4-bfce-4122-9fb2-32b1f970ff55', '0789bfc9-aeff-4497-87d9-17d81cb68af7', '1af5d5fc-56e8-46a0-bb86-44745c27664e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:52 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Delete snapshot completed successfully. Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-71056702-ae8c-46a3-9d88-5f57f97238a2 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-d86c385d-d944-4273-ad2a-5b48f4b1e761-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-quobyte-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c09ca8-46db-439e-81f9-421233dbe6f2]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 Sep 01 02:21:52 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 26348df7-a1c7-442d-8d4f-0c0d4ea08c8c of volume f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:52 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" returned: 0 in 0.365s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c6b97-1a7c-4baa-ad68-78cd6e85a67e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5 Sep 01 02:21:52 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 Sep 01 02:21:53 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" returned: 0 in 0.269s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5" released by "delete_volume" :: held 0.695s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Created reservations ['330e704d-3e8b-4361-8bff-62306b8408e6', '632dd2eb-c512-4b1b-bf33-902e06dd7b4e', 'f473b1f3-7254-4c48-b343-02e9b1fc7e83', 'ac6fc4fd-77aa-4634-846b-4e32f5a44d0e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:53 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" returned: 0 in 0.403s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c 1G Sep 01 02:21:53 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:53 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-38bedb6d-81c3-4313-a265-885c0ecdb02f-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.283s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Deleted volume successfully. Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-38bedb6d-81c3-4313-a265-885c0ecdb02f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e4d3a7ee-a4df-4dd1-9468-0a0a80a4e169 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-aeeef6b4-505b-4f74-abde-7cd1d1f1fec5-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "cinder-quobyte-38bedb6d-81c3-4313-a265-885c0ecdb02f" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-38bedb6d-81c3-4313-a265-885c0ecdb02f" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:53 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c 1G" returned: 0 in 0.502s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d05ebf-655b-4260-836e-ff7a55194de2]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c Sep 01 02:21:53 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f Sep 01 02:21:53 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" returned: 0 in 0.323s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c is being set with open permissions: ugo+rw Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c Sep 01 02:21:54 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f" returned: 0 in 0.397s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f Sep 01 02:21:54 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info Sep 01 02:21:54 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-38bedb6d-81c3-4313-a265-885c0ecdb02f" returned: 0 in 0.267s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-quobyte-38bedb6d-81c3-4313-a265-885c0ecdb02f" released by "delete_volume" :: held 0.729s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Created reservations ['d62f05b1-e50a-435f-b50a-e21c6da573f0', 'f42fb2e3-d724-4543-bcea-5b1ae43b2f7a', 'b10ed55c-f71a-4855-b44e-a6db076eb584', 'c35f1cd9-972c-4b8e-9431-248569cdbaa9'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:54 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info is being set with open permissions: ugo+rw Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info Sep 01 02:21:54 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.339s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Deleted volume successfully. Sep 01 02:21:55 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8cd872b2-6b2f-4723-bc0b-62b7b16f6f00 tempest-SnapshotDependencyTests-265832596 None] Lock "cinder-38bedb6d-81c3-4313-a265-885c0ecdb02f-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:55 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.info" returned: 0 in 0.406s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:55 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d28e34bf-f4ec-47aa-a964-65221b508224 tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-26348df7-a1c7-442d-8d4f-0c0d4ea08c8c-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Lock "cinder-26348df7-a1c7-442d-8d4f-0c0d4ea08c8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 26348df7-a1c7-442d-8d4f-0c0d4ea08c8c of volume f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22200c5-9e02-4095-894c-9c1f71e8681e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c Sep 01 02:21:56 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" returned: 0 in 0.413s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea08aa7e-5f60-4453-aa1e-f59c31aedb4d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 Sep 01 02:21:56 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:57 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" returned: 0 in 0.432s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:57 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c Sep 01 02:21:57 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:57 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" returned: 0 in 0.428s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:57 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c Sep 01 02:21:57 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:57 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919.26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" returned: 0 in 0.286s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-26348df7-a1c7-442d-8d4f-0c0d4ea08c8c" released by "_delete_snapshot" :: held 1.687s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" released by "delete_snapshot" :: held 1.715s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Created reservations ['33343e59-1eab-413e-b45d-f3040dc3601f', '1a9811df-418b-4823-abc3-88975c373399', '0aff5bc5-a3f1-4f59-9d3e-654e1b9cbb60', '6a85e147-199a-4db7-9ad2-4bab76d457de'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:57 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:21:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e69e3cdf-7d43-45af-b4d7-769df3e4b473 tempest-ProjectMemberTests-481405712 None] Lock "cinder-26348df7-a1c7-442d-8d4f-0c0d4ea08c8c-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-f9dcf063-2b0c-44bc-be87-f39fd9cf5919-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Lock "cinder-f9dcf063-2b0c-44bc-be87-f39fd9cf5919-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" acquired by "delete_volume" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b287e5-9ddd-44dc-8b34-791d2f5da767]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:58 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 Sep 01 02:21:58 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:58 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" returned: 0 in 0.482s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:58 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919 Sep 01 02:21:58 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:59 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" returned: 0 in 0.288s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-f9dcf063-2b0c-44bc-be87-f39fd9cf5919" released by "delete_volume" :: held 0.833s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Created reservations ['7d771a8e-e7a4-485d-bb64-75b02e23184c', '93149010-622e-4d75-9483-0762e6fc3e4c', 'fe4a4383-4bfe-483f-bf82-2c9d7165d4d4', 'a91bd30b-093c-44be-a481-c462eb5fc33a'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:59 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:21:59 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:59 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.276s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:59 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:21:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1da5df93-7501-4e77-9e09-15cf375d0a5e tempest-ProjectMemberTests-481405712 None] Lock "cinder-f9dcf063-2b0c-44bc-be87-f39fd9cf5919-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (e2db5478-ebfd-4deb-97ab-62bfcc3806bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22d6bde-ca9d-4558-8f4a-c93e4fcabdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22d6bde-ca9d-4558-8f4a-c93e4fcabdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767433996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef537e81-955a-46dd-9817-eba3b416ebbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:00Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9794482-d77a-4546-91cf-dd568c358c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9794482-d77a-4546-91cf-dd568c358c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4bee8c-be80-4aab-ae6a-a0e6018e62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4bee8c-be80-4aab-ae6a-a0e6018e62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef537e81-955a-46dd-9817-eba3b416ebbe', 'volume_name': 'volume-ef537e81-955a-46dd-9817-eba3b416ebbe', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa8f2b0-b322-4685-9912-f6196a09b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa8f2b0-b322-4685-9912-f6196a09b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92691bc5-b640-4a65-8816-b1013439041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Volume ef537e81-955a-46dd-9817-eba3b416ebbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef537e81-955a-46dd-9817-eba3b416ebbe', 'volume_size': 1} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767433996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef537e81-955a-46dd-9817-eba3b416ebbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:00Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Creating volume ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:00 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:00 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe 1073741824 Sep 01 02:22:00 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:00 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe 1073741824" returned: 0 in 0.514s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:00 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe Sep 01 02:22:00 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:01 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe" returned: 0 in 0.273s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92691bc5-b640-4a65-8816-b1013439041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef537e81-955a-46dd-9817-eba3b416ebbe', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4479668-b557-4ed7-bbcb-95fa120957e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:01 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Volume volume-ef537e81-955a-46dd-9817-eba3b416ebbe (ef537e81-955a-46dd-9817-eba3b416ebbe): created successfully Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4479668-b557-4ed7-bbcb-95fa120957e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:01 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (e2db5478-ebfd-4deb-97ab-62bfcc3806bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:01 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5c51780f-6dd0-451b-be01-7e5195577379 tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 547ef9b6-c8b2-4edb-bf42-d471cb852ce6 of volume ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[185026ee-8974-42aa-bc52-892777b2deec]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe Sep 01 02:22:02 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe" returned: 0 in 0.362s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 1G Sep 01 02:22:02 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 1G" returned: 0 in 0.444s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef537e81-955a-46dd-9817-eba3b416ebbe -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef537e81-955a-46dd-9817-eba3b416ebbe -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 Sep 01 02:22:03 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef537e81-955a-46dd-9817-eba3b416ebbe -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:03 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 is being set with open permissions: ugo+rw Sep 01 02:22:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 Sep 01 02:22:03 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6" returned: 0 in 0.236s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:03 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info Sep 01 02:22:03 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:04 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info" returned: 0 in 0.257s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info is being set with open permissions: ugo+rw Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:04 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info Sep 01 02:22:04 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:04 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.info" returned: 0 in 0.299s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:04 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-65c18706-63ce-4dfe-a47c-c3f1095e0ed6 tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-547ef9b6-c8b2-4edb-bf42-d471cb852ce6-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Lock "cinder-547ef9b6-c8b2-4edb-bf42-d471cb852ce6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-ef537e81-955a-46dd-9817-eba3b416ebbe" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ef537e81-955a-46dd-9817-eba3b416ebbe" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-547ef9b6-c8b2-4edb-bf42-d471cb852ce6" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-547ef9b6-c8b2-4edb-bf42-d471cb852ce6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 547ef9b6-c8b2-4edb-bf42-d471cb852ce6 of volume ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa454bff-c442-4772-a958-84d19c3d9191]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:04 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 Sep 01 02:22:04 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:05 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6" returned: 0 in 0.469s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef537e81-955a-46dd-9817-eba3b416ebbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd0399-dcff-4459-9335-f835edae5716]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe Sep 01 02:22:05 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:05 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe" returned: 0 in 0.371s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 Sep 01 02:22:05 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:05 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6 Sep 01 02:22:05 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:06 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe.547ef9b6-c8b2-4edb-bf42-d471cb852ce6" returned: 0 in 0.277s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-547ef9b6-c8b2-4edb-bf42-d471cb852ce6" released by "_delete_snapshot" :: held 1.597s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ef537e81-955a-46dd-9817-eba3b416ebbe" released by "delete_snapshot" :: held 1.618s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Created reservations ['fbc9be7b-e5a6-411c-9a47-5696b0dc9cf8', 'c4ca52f0-a2c6-451a-931e-30ebfa78e9d8', 'bd3c7022-daf3-4957-8769-0f82a786bef2', 'e5792a74-3929-403f-881b-6107ac05421e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-fcdfdbf4-de40-4370-af4b-7af5eadd3478 tempest-ProjectMemberTests-481405712 None] Lock "cinder-547ef9b6-c8b2-4edb-bf42-d471cb852ce6-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-ef537e81-955a-46dd-9817-eba3b416ebbe-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Lock "cinder-ef537e81-955a-46dd-9817-eba3b416ebbe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-ef537e81-955a-46dd-9817-eba3b416ebbe" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ef537e81-955a-46dd-9817-eba3b416ebbe" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d8adbb-1dea-4b97-9afd-7d06a66819c8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:06 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe Sep 01 02:22:06 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:07 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe" returned: 0 in 0.346s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:07 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe Sep 01 02:22:07 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:07 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-ef537e81-955a-46dd-9817-eba3b416ebbe" returned: 0 in 0.228s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-ef537e81-955a-46dd-9817-eba3b416ebbe" released by "delete_volume" :: held 0.631s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Created reservations ['23423ded-91b8-4eb2-8b47-e860390de639', '2749e027-885e-4044-87ce-62993f2a4569', 'fb8a7b75-22ee-4b40-bc97-f99b4bec414e', '5adb0c88-0e2f-4f68-a503-2e3f69436ebc'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:07 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:07 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:07 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.239s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:22:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-53b5df0a-f3b6-4aef-afba-5df923b0fd7a tempest-ProjectMemberTests-481405712 None] Lock "cinder-ef537e81-955a-46dd-9817-eba3b416ebbe-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (6dac8f48-3a97-4f6e-984b-19ea158f4e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a5f083-5165-4f9f-9da4-72a7b5c8a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a5f083-5165-4f9f-9da4-72a7b5c8a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395949473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2373b566-f74c-4922-85a5-57731ecd296d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:08Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b78474c-9598-4c15-8ba3-818dc800c52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b78474c-9598-4c15-8ba3-818dc800c52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe09730-32ba-44dc-aa16-08b1dc454003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe09730-32ba-44dc-aa16-08b1dc454003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2373b566-f74c-4922-85a5-57731ecd296d', 'volume_name': 'volume-2373b566-f74c-4922-85a5-57731ecd296d', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de20bec7-1577-49e6-b8bd-d74c1387ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de20bec7-1577-49e6-b8bd-d74c1387ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b11c4-c27b-454c-a283-1e700dbc9f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:08 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Volume 2373b566-f74c-4922-85a5-57731ecd296d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2373b566-f74c-4922-85a5-57731ecd296d', 'volume_size': 1} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395949473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2373b566-f74c-4922-85a5-57731ecd296d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:08Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Creating volume 2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:08 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:08 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d 1073741824 Sep 01 02:22:08 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:08 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d 1073741824" returned: 0 in 0.394s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:08 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d Sep 01 02:22:08 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:09 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d" returned: 0 in 0.241s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b11c4-c27b-454c-a283-1e700dbc9f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2373b566-f74c-4922-85a5-57731ecd296d', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64321d59-e06f-4454-af0c-7bb800f9617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Volume volume-2373b566-f74c-4922-85a5-57731ecd296d (2373b566-f74c-4922-85a5-57731ecd296d): created successfully Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64321d59-e06f-4454-af0c-7bb800f9617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (6dac8f48-3a97-4f6e-984b-19ea158f4e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f87c9156-e997-497b-870d-023059bd991f tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Creating offline snapshot 37047518-f40c-4210-978e-228d2b7971a4 of volume 2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9dc7bd-cd46-43ac-bd54-d37c5f74f878]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:09 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d Sep 01 02:22:09 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:09 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d" returned: 0 in 0.357s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:09 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:09 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 1G Sep 01 02:22:09 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 1G" returned: 0 in 0.382s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2373b566-f74c-4922-85a5-57731ecd296d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2373b566-f74c-4922-85a5-57731ecd296d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 Sep 01 02:22:10 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2373b566-f74c-4922-85a5-57731ecd296d -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4" returned: 0 in 0.278s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:10 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 is being set with open permissions: ugo+rw Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 Sep 01 02:22:10 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4" returned: 0 in 0.229s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info Sep 01 02:22:10 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info" returned: 0 in 0.233s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:10 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info is being set with open permissions: ugo+rw Sep 01 02:22:10 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info Sep 01 02:22:10 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:11 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.info" returned: 0 in 0.231s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.782s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:11 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-dbbf2c33-51c1-4afe-b4c2-0fd347327533 tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-37047518-f40c-4210-978e-228d2b7971a4-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-37047518-f40c-4210-978e-228d2b7971a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-2373b566-f74c-4922-85a5-57731ecd296d" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-2373b566-f74c-4922-85a5-57731ecd296d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-37047518-f40c-4210-978e-228d2b7971a4" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-37047518-f40c-4210-978e-228d2b7971a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot 37047518-f40c-4210-978e-228d2b7971a4 of volume 2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1807b-3299-42ed-9226-d28859470446]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:11 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 Sep 01 02:22:11 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:11 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4" returned: 0 in 0.339s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:11 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2373b566-f74c-4922-85a5-57731ecd296d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cebf5e-8163-4898-98e5-e6e8e4b2088e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:12 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d Sep 01 02:22:12 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:12 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:12 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 Sep 01 02:22:12 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:12 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4" returned: 0 in 0.320s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:12 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4 Sep 01 02:22:12 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:12 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d.37047518-f40c-4210-978e-228d2b7971a4" returned: 0 in 0.231s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-37047518-f40c-4210-978e-228d2b7971a4" released by "_delete_snapshot" :: held 1.311s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-2373b566-f74c-4922-85a5-57731ecd296d" released by "delete_snapshot" :: held 1.331s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=149,cinder:DELETE=18,cinder:INSERT=46,cinder:SELECT=131 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:12 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:UPDATE=168,cinder:SELECT=125,cinder:INSERT=46,cinder:DELETE=10 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Created reservations ['41d7cbc0-d42a-499b-a871-8a15c7f400c7', 'c4db47ce-37e1-4165-83a9-608bc0edd13b', 'f3478b02-c421-4400-a992-031ea3309ba1', 'f9184b0f-dc5c-49d4-aade-a16d1694d421'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:13 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e6be55eb-1f0e-4e0c-a1c7-5dac20f529b9 tempest-ProjectMemberTests-481405712 None] Lock "cinder-37047518-f40c-4210-978e-228d2b7971a4-delete_snapshot" released by "delete_snapshot" :: held 1.465s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-2373b566-f74c-4922-85a5-57731ecd296d-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Lock "cinder-2373b566-f74c-4922-85a5-57731ecd296d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-2373b566-f74c-4922-85a5-57731ecd296d" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-2373b566-f74c-4922-85a5-57731ecd296d" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d379bc0-42c9-4703-9378-35981ae3cc09]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:13 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:13 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d Sep 01 02:22:13 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:14 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d" returned: 0 in 0.355s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:14 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d Sep 01 02:22:14 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:14 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-2373b566-f74c-4922-85a5-57731ecd296d" returned: 0 in 0.241s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-2373b566-f74c-4922-85a5-57731ecd296d" released by "delete_volume" :: held 0.646s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Created reservations ['8b3f50fd-bbe9-4d52-8a1a-4301954ad6bb', '7dc99d2f-798c-42cb-b1b3-571610441fff', 'eff0977f-0ebc-40f0-a2ab-985f97fce53d', '5863b924-32eb-428e-811f-19473735f45b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:14 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:14 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:14 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:14 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:22:14 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8166878b-4069-445d-8c16-4c34d230a06f tempest-ProjectMemberTests-481405712 None] Lock "cinder-2373b566-f74c-4922-85a5-57731ecd296d-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (515134d7-aef5-48b5-9861-2236c2dc6096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bc44fa-dbf4-4d62-8147-a245c468053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bc44fa-dbf4-4d62-8147-a245c468053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1949176157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105d1b3f-f911-40b1-a0c8-9e8cc7d22a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:15Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f6e131-4c78-4116-b576-a68fe25d67f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f6e131-4c78-4116-b576-a68fe25d67f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3793291-2aec-4c50-b9bb-372f4e4b344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3793291-2aec-4c50-b9bb-372f4e4b344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105d1b3f-f911-40b1-a0c8-9e8cc7d22a07', 'volume_name': 'volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ee6951-d2fd-4b56-8a4e-fabac457f207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ee6951-d2fd-4b56-8a4e-fabac457f207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad499dc-7d18-41e2-a481-d01ac5638fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:15 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Volume 105d1b3f-f911-40b1-a0c8-9e8cc7d22a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07', 'volume_size': 1} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1949176157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105d1b3f-f911-40b1-a0c8-9e8cc7d22a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fec98ec2f4b9799fc4b3043f5f01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:15Z,use_quota=True,user_id='47fa948f98824b23af50d58d6503bfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Creating volume 105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:15 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:15 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 1073741824 Sep 01 02:22:15 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:15 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 1073741824" returned: 0 in 0.402s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:15 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:15 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 Sep 01 02:22:15 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:16 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" returned: 0 in 0.240s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad499dc-7d18-41e2-a481-d01ac5638fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96238ca5-cb0f-40c7-b56e-e11db6ab85eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:16 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Volume volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 (105d1b3f-f911-40b1-a0c8-9e8cc7d22a07): created successfully Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96238ca5-cb0f-40c7-b56e-e11db6ab85eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Flow 'volume_create_manager' (515134d7-aef5-48b5-9861-2236c2dc6096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:16 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-10b30a22-e0fb-46f3-9b3f-1f1385a68a74 tempest-ProjectMemberTests-481405712 None] Created volume successfully. Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Creating offline snapshot a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 of volume 105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c35b20-cc66-433f-9870-f262f3d64f5e]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:16 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 Sep 01 02:22:16 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:16 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" returned: 0 in 0.365s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:16 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:16 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 1G Sep 01 02:22:16 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 1G" returned: 0 in 0.379s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 Sep 01 02:22:17 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" returned: 0 in 0.285s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 is being set with open permissions: ugo+rw Sep 01 02:22:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 Sep 01 02:22:17 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" returned: 0 in 0.234s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info Sep 01 02:22:17 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info" returned: 0 in 0.258s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info is being set with open permissions: ugo+rw Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info Sep 01 02:22:18 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.info" returned: 0 in 0.235s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:18 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c43aa1ae-fb35-4b11-b319-b3466046fadf tempest-ProjectMemberTests-481405712 None] Create snapshot completed successfully Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Lock "cinder-a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Deleting offline snapshot a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 of volume 105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] snapshot_file for this snap is: volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a41bd-3a80-4859-ab40-a8aa8694528a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:18 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 Sep 01 02:22:18 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62f07f-b6b9-4f66-bc26-199b6cfcab62]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 Sep 01 02:22:19 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" returned: 0 in 0.348s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 Sep 01 02:22:19 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" returned: 0 in 0.343s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355 Sep 01 02:22:19 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07.a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355" released by "_delete_snapshot" :: held 1.376s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" released by "delete_snapshot" :: held 1.397s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Created reservations ['926659b9-f1ad-4fcb-95a4-64e717abb204', '5e0bc669-4175-4848-a6a3-6415d3635249', '03245c2f-102f-4747-b298-9a3cf2e44acc', 'cfb4d79a-0bf0-4f64-a117-aff023abc0a5'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:20 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Delete snapshot completed successfully. Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-f1126827-c638-4244-91ce-1ee0f5fcfe51 tempest-ProjectMemberTests-481405712 None] Lock "cinder-a1d8cbae-30cc-4e5f-9dc9-41f4d0c3e355-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Lock "cinder-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Acquiring lock "cinder-quobyte-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b7bf8e-8182-46dd-8c44-e78d6deb2bad]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:20 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 Sep 01 02:22:21 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" returned: 0 in 0.345s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07 Sep 01 02:22:21 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" returned: 0 in 0.234s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Lock "cinder-quobyte-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07" released by "delete_volume" :: held 0.637s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Created reservations ['b7f53b85-eeca-4571-90a2-b1941d69b76a', 'accd834c-fdc1-47d6-b770-b412d25dcb4c', 'ec57c76d-32ca-4f4b-a29f-58ed9d06065b', '15821ee4-04d6-4cb0-81ce-9d5407db1218'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:21 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.241s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:21 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Deleted volume successfully. Sep 01 02:22:21 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-a37d8fd8-174b-48ca-9bb8-51c9f799172b tempest-ProjectMemberTests-481405712 None] Lock "cinder-105d1b3f-f911-40b1-a0c8-9e8cc7d22a07-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (bdee4081-f1dd-49af-bb87-b47e98edd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b4a27-fdb5-4217-aa9d-7285f2e54ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b4a27-fdb5-4217-aa9d-7285f2e54ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538746718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73247d6-cd02-4f08-b18a-1e99b1fadb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:25Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4925fae3-cc8c-44e3-891b-aeed06f312e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4925fae3-cc8c-44e3-891b-aeed06f312e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cd413a-4b7b-4861-9807-699acd98e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cd413a-4b7b-4861-9807-699acd98e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73247d6-cd02-4f08-b18a-1e99b1fadb72', 'volume_name': 'volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e424c952-9f45-411e-8f38-8fe0afee18e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e424c952-9f45-411e-8f38-8fe0afee18e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b3e32-f6fc-4bd8-97ed-e08d5ad18414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:25 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Volume d73247d6-cd02-4f08-b18a-1e99b1fadb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72', 'volume_size': 1} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538746718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73247d6-cd02-4f08-b18a-1e99b1fadb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:25Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Creating volume d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:25 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:25 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:25 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 1073741824 Sep 01 02:22:25 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:26 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 1073741824" returned: 0 in 0.403s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:26 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 Sep 01 02:22:26 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:26 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72" returned: 0 in 0.236s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b3e32-f6fc-4bd8-97ed-e08d5ad18414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03baa7-42b0-4cf2-bc4a-1ea5341687d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:26 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Volume volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 (d73247d6-cd02-4f08-b18a-1e99b1fadb72): created successfully Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03baa7-42b0-4cf2-bc4a-1ea5341687d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (bdee4081-f1dd-49af-bb87-b47e98edd5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:26 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-c7d03b27-b855-43f8-b4b2-d80a34b5c695 tempest-ProjectReaderTests-916938675 None] Created volume successfully. Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Creating offline snapshot b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 of volume d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[def4236b-b2f4-4f0b-a71f-26c56566c60b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:26 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:26 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 Sep 01 02:22:26 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72" returned: 0 in 0.358s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:27 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 1G Sep 01 02:22:27 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 1G" returned: 0 in 0.372s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:27 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 Sep 01 02:22:27 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" returned: 0 in 0.276s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 is being set with open permissions: ugo+rw Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:27 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 Sep 01 02:22:27 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" returned: 0 in 0.228s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info Sep 01 02:22:28 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:28 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info" returned: 0 in 0.234s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:28 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info is being set with open permissions: ugo+rw Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info Sep 01 02:22:28 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:28 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.info" returned: 0 in 0.238s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:28 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2a08a512-d56e-4267-893f-27790d42ff11 tempest-ProjectReaderTests-916938675 None] Create snapshot completed successfully Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:28 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:28 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.237s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-b97c2a09-e95f-4c29-93d9-0fdb1faf6e81-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Lock "cinder-b97c2a09-e95f-4c29-93d9-0fdb1faf6e81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-d73247d6-cd02-4f08-b18a-1e99b1fadb72" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d73247d6-cd02-4f08-b18a-1e99b1fadb72" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Deleting offline snapshot b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 of volume d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] snapshot_file for this snap is: volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[defa73ff-78de-4c18-b14e-4ec6ad967857]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:29 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 Sep 01 02:22:29 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f4e4ea-3391-472d-814b-d975d0094233]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:29 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 Sep 01 02:22:29 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72" returned: 0 in 0.360s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:29 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 Sep 01 02:22:29 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:30 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" returned: 0 in 0.330s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:30 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81 Sep 01 02:22:30 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:30 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72.b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" returned: 0 in 0.229s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-b97c2a09-e95f-4c29-93d9-0fdb1faf6e81" released by "_delete_snapshot" :: held 1.353s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d73247d6-cd02-4f08-b18a-1e99b1fadb72" released by "delete_snapshot" :: held 1.375s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Created reservations ['ed739803-ea98-4fc7-b317-095f9e69ce6c', '3b712b70-e10f-44b8-8ac8-0df635ce3c89', 'b2565175-aa59-4d91-b23b-d0f0ff363fb1', 'ce7f5f70-9414-4cc3-9fa9-4d5b65df7ff4'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:30 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Delete snapshot completed successfully. Sep 01 02:22:30 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-06f9b417-036b-4d39-82ed-8effd7772b55 tempest-ProjectReaderTests-916938675 None] Lock "cinder-b97c2a09-e95f-4c29-93d9-0fdb1faf6e81-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-d73247d6-cd02-4f08-b18a-1e99b1fadb72-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Lock "cinder-d73247d6-cd02-4f08-b18a-1e99b1fadb72-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-d73247d6-cd02-4f08-b18a-1e99b1fadb72" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d73247d6-cd02-4f08-b18a-1e99b1fadb72" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf57135-50be-4ce4-98a4-737e99c87a2d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:31 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 Sep 01 02:22:31 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:31 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72" returned: 0 in 0.340s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:31 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72 Sep 01 02:22:31 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:31 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d73247d6-cd02-4f08-b18a-1e99b1fadb72" returned: 0 in 0.252s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d73247d6-cd02-4f08-b18a-1e99b1fadb72" released by "delete_volume" :: held 0.647s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Created reservations ['1251ecc1-10ab-4740-85e8-a8aed0de06ec', '43716e3e-1b8f-47ad-baf2-6b097a0cd0cb', 'a445d1a5-0a6c-40e4-b371-cb200be9f206', '3ee0996b-02f4-45e6-897b-30711fd7bcb1'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:31 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:31 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:31 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:32 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.268s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:32 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Deleted volume successfully. Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-0808a788-e2dd-4bbc-a4fb-d138d6df83b9 tempest-ProjectReaderTests-916938675 None] Lock "cinder-d73247d6-cd02-4f08-b18a-1e99b1fadb72-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (e3c62b7d-b554-4a3e-b575-4f991abc6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4847a1b-3675-441c-9b58-bfce63096e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4847a1b-3675-441c-9b58-bfce63096e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321106545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1825eb2-5c19-411e-80ae-ca6f1deca448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:33Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1599fa46-682e-4ed9-a347-390b0c4ee388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1599fa46-682e-4ed9-a347-390b0c4ee388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3f4572-8ea7-4930-9138-8cd6f7d80a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3f4572-8ea7-4930-9138-8cd6f7d80a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1825eb2-5c19-411e-80ae-ca6f1deca448', 'volume_name': 'volume-d1825eb2-5c19-411e-80ae-ca6f1deca448', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55aaa56a-eb75-4873-b192-e1440d3f8497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55aaa56a-eb75-4873-b192-e1440d3f8497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e487fec-34bb-4100-aaae-da7776af88a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:32 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Volume d1825eb2-5c19-411e-80ae-ca6f1deca448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1825eb2-5c19-411e-80ae-ca6f1deca448', 'volume_size': 1} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321106545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1825eb2-5c19-411e-80ae-ca6f1deca448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:33Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Creating volume d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:32 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:32 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:32 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 1073741824 Sep 01 02:22:32 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:33 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 1073741824" returned: 0 in 0.408s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:33 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 Sep 01 02:22:33 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:33 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448" returned: 0 in 0.246s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e487fec-34bb-4100-aaae-da7776af88a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1825eb2-5c19-411e-80ae-ca6f1deca448', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfd1c3e-a985-4050-b277-28cbf9db8b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:33 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Volume volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 (d1825eb2-5c19-411e-80ae-ca6f1deca448): created successfully Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfd1c3e-a985-4050-b277-28cbf9db8b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (e3c62b7d-b554-4a3e-b575-4f991abc6243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:33 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2df6b57b-f67e-4d64-8e44-7cfaaf70758c tempest-ProjectReaderTests-916938675 None] Created volume successfully. Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Creating offline snapshot 90633eed-1194-4d64-a725-ee9fb9a9c251 of volume d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b0c908-015d-40db-951b-0cb946f53a4c]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:33 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:33 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 Sep 01 02:22:33 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:34 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448" returned: 0 in 0.375s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:34 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 1G Sep 01 02:22:34 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:34 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 1G" returned: 0 in 0.392s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:34 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 Sep 01 02:22:34 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:34 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251" returned: 0 in 0.283s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:34 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 is being set with open permissions: ugo+rw Sep 01 02:22:34 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:34 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 Sep 01 02:22:34 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:35 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:35 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info Sep 01 02:22:35 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:35 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info" returned: 0 in 0.239s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:35 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info is being set with open permissions: ugo+rw Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:35 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info Sep 01 02:22:35 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:35 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.info" returned: 0 in 0.230s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:35 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-11d3da53-44c9-4289-ba22-9d4771beb499 tempest-ProjectReaderTests-916938675 None] Create snapshot completed successfully Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-90633eed-1194-4d64-a725-ee9fb9a9c251-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Lock "cinder-90633eed-1194-4d64-a725-ee9fb9a9c251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-d1825eb2-5c19-411e-80ae-ca6f1deca448" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d1825eb2-5c19-411e-80ae-ca6f1deca448" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:35 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-90633eed-1194-4d64-a725-ee9fb9a9c251" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-90633eed-1194-4d64-a725-ee9fb9a9c251" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Deleting offline snapshot 90633eed-1194-4d64-a725-ee9fb9a9c251 of volume d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] snapshot_file for this snap is: volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d26cca4-d83c-4a14-9ffb-f53350b08a20]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:36 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 Sep 01 02:22:36 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:36 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251" returned: 0 in 0.340s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1825eb2-5c19-411e-80ae-ca6f1deca448(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a58b42-4b6d-4e85-9cbe-43f8358f5114]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:36 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 Sep 01 02:22:36 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:36 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448" returned: 0 in 0.338s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:36 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:36 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 Sep 01 02:22:36 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:37 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251" returned: 0 in 0.323s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:37 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251 Sep 01 02:22:37 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:37 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448.90633eed-1194-4d64-a725-ee9fb9a9c251" returned: 0 in 0.235s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-90633eed-1194-4d64-a725-ee9fb9a9c251" released by "_delete_snapshot" :: held 1.329s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d1825eb2-5c19-411e-80ae-ca6f1deca448" released by "delete_snapshot" :: held 1.352s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Created reservations ['091f60f7-6793-4ade-9235-a76985318c40', 'c8d0244d-8a5e-4fe1-be90-76292f75f47b', '23f6b88f-808f-45ea-8415-177031d1c083', '2804d993-cc23-43b1-b6a2-d7f2bdd649a3'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:37 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Delete snapshot completed successfully. Sep 01 02:22:37 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-8d6af522-8949-43b2-ac88-e3910698a058 tempest-ProjectReaderTests-916938675 None] Lock "cinder-90633eed-1194-4d64-a725-ee9fb9a9c251-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-d1825eb2-5c19-411e-80ae-ca6f1deca448-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Lock "cinder-d1825eb2-5c19-411e-80ae-ca6f1deca448-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-d1825eb2-5c19-411e-80ae-ca6f1deca448" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d1825eb2-5c19-411e-80ae-ca6f1deca448" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde0e3f-90f4-4c4d-89e0-e79add9c1409]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:38 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 Sep 01 02:22:38 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:38 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448" returned: 0 in 0.346s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:38 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448 Sep 01 02:22:38 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:38 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-d1825eb2-5c19-411e-80ae-ca6f1deca448" returned: 0 in 0.254s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-d1825eb2-5c19-411e-80ae-ca6f1deca448" released by "delete_volume" :: held 0.653s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Created reservations ['790288ac-00ea-47e4-8fc3-c505a9fa54d4', '4cf57aa2-d544-4dd8-b951-79ccf0190f80', '90005a49-06ce-424d-aa94-b16080a95946', '24511eb4-6c94-42a1-8052-c09141246d9b'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:38 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:38 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:38 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:39 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.296s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:39 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Deleted volume successfully. Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-682cb910-a69c-452d-8974-e3c9d41805f1 tempest-ProjectReaderTests-916938675 None] Lock "cinder-d1825eb2-5c19-411e-80ae-ca6f1deca448-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (32496b38-e68f-48c9-b46f-0ed8c20f7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dbae12-a84c-4ee3-9b94-652dbcff9f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dbae12-a84c-4ee3-9b94-652dbcff9f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882058285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:40Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c576ce-3d06-4793-b52b-1683ab1e7fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c576ce-3d06-4793-b52b-1683ab1e7fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad258f0b-8f42-4d2a-b73a-4240067f9d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad258f0b-8f42-4d2a-b73a-4240067f9d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8', 'volume_name': 'volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4add555-f4ca-427d-bfc8-7e85b9def032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4add555-f4ca-427d-bfc8-7e85b9def032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495e9d5c-0625-455a-9579-5658988fe5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:39 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Volume b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8', 'volume_size': 1} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882058285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:40Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Creating volume b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:39 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:39 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:39 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 1073741824 Sep 01 02:22:39 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:40 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 1073741824" returned: 0 in 0.411s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:40 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 Sep 01 02:22:40 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:40 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" returned: 0 in 0.239s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495e9d5c-0625-455a-9579-5658988fe5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6cf3a1-b6fd-4afd-aa82-2400787cafd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:40 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Volume volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 (b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8): created successfully Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6cf3a1-b6fd-4afd-aa82-2400787cafd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (32496b38-e68f-48c9-b46f-0ed8c20f7804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:40 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-4c1b89a1-108c-4a96-ab71-37d921bce626 tempest-ProjectReaderTests-916938675 None] Created volume successfully. Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Creating offline snapshot c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f of volume b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4938c-0439-4c7b-a61e-a39e442ecb5a]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:40 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 Sep 01 02:22:41 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f 1G Sep 01 02:22:41 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f 1G" returned: 0 in 0.402s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f Sep 01 02:22:41 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" returned: 0 in 0.282s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f is being set with open permissions: ugo+rw Sep 01 02:22:41 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f Sep 01 02:22:42 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:42 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" returned: 0 in 0.242s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:42 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info Sep 01 02:22:42 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:42 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info" returned: 0 in 0.237s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:42 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info is being set with open permissions: ugo+rw Sep 01 02:22:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:42 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info Sep 01 02:22:42 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:42 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.info" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:42 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:42 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-63833431-064b-465c-89fd-d4c5010db314 tempest-ProjectReaderTests-916938675 None] Create snapshot completed successfully Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Lock "cinder-c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Deleting offline snapshot c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f of volume b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] snapshot_file for this snap is: volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e482f290-543a-4455-9558-bb5dbb251abe]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:43 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f Sep 01 02:22:43 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:43 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" returned: 0 in 0.374s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[97da4603-3292-4288-88c4-5384315a5cc8]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:43 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 Sep 01 02:22:43 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:43 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" returned: 0 in 0.348s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:43 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:43 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f Sep 01 02:22:43 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" returned: 0 in 0.332s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f Sep 01 02:22:44 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8.c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f" released by "_delete_snapshot" :: held 1.407s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" released by "delete_snapshot" :: held 1.429s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Created reservations ['77e4201c-6674-4a01-8d45-9a89d4dd89be', 'c3361afa-2286-41c0-9f8f-0fd96ede99db', 'bb7658c7-ffde-4af3-ae0b-984de0f68886', '5c278839-983f-469f-98e8-9a0ab548d7b6'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:44 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Delete snapshot completed successfully. Sep 01 02:22:44 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-6fb4f7ea-ded0-4bfe-9c2d-d7628e542e3f tempest-ProjectReaderTests-916938675 None] Lock "cinder-c5fcf50e-caaa-4bcf-9e67-d66c2b2d6b3f-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Lock "cinder-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb4801-686f-45a4-8902-52d2e9a16cb0]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:45 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 Sep 01 02:22:45 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:45 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" returned: 0 in 0.370s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:45 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8 Sep 01 02:22:45 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:45 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" returned: 0 in 0.250s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8" released by "delete_volume" :: held 0.688s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:45 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Created reservations ['d12efd71-111e-4f96-bb3f-dd95a2b857da', 'a603a6ef-d8d6-4972-beb6-ce85d0d89f09', '0b4c97ba-b90d-402e-93f3-844d37969814', '08850d49-9581-4456-a449-6215f25fba2e'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:46 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:46 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:46 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.260s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:46 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Deleted volume successfully. Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-699572c7-e1e1-4fd0-9f45-da4b8395f361 tempest-ProjectReaderTests-916938675 None] Lock "cinder-b3ce3aa6-adfb-4aa8-b3a2-e071d69336b8-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (23529da9-6d45-4a3d-965a-99347e167c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7311332-2460-46fd-96cf-99e8a82b526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7311332-2460-46fd-96cf-99e8a82b526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510382410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97822bdf-1ff8-46c0-8d53-abad6af08d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:47Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d45268e-1bf1-414f-b6ec-873f84d89085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d45268e-1bf1-414f-b6ec-873f84d89085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde1f6ce-2adc-47d7-a6d4-4ac649e25178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde1f6ce-2adc-47d7-a6d4-4ac649e25178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97822bdf-1ff8-46c0-8d53-abad6af08d39', 'volume_name': 'volume-97822bdf-1ff8-46c0-8d53-abad6af08d39', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda280cf-8e4f-47f7-b60e-eacbbb45cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda280cf-8e4f-47f7-b60e-eacbbb45cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d9316d-7c94-4f69-8c84-555d21fedf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:46 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Volume 97822bdf-1ff8-46c0-8d53-abad6af08d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97822bdf-1ff8-46c0-8d53-abad6af08d39', 'volume_size': 1} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510382410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97822bdf-1ff8-46c0-8d53-abad6af08d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:47Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Creating volume 97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:46 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:46 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:46 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 1073741824 Sep 01 02:22:46 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 1073741824" returned: 0 in 0.440s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:47 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 Sep 01 02:22:47 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39" returned: 0 in 0.264s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d9316d-7c94-4f69-8c84-555d21fedf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97822bdf-1ff8-46c0-8d53-abad6af08d39', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c644228f-63d9-4527-b539-3cdd5575cbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:47 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Volume volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 (97822bdf-1ff8-46c0-8d53-abad6af08d39): created successfully Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c644228f-63d9-4527-b539-3cdd5575cbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (23529da9-6d45-4a3d-965a-99347e167c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:47 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-9c9bad34-6151-4189-96f2-1e5d70d7aea8 tempest-ProjectReaderTests-916938675 None] Created volume successfully. Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:47 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Creating offline snapshot 3921a7b4-6af2-4c92-a881-7e37ca0a8cbc of volume 97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9de330-6300-4472-a3d9-505555a2e6bf]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:48 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 Sep 01 02:22:48 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:48 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39" returned: 0 in 0.362s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:48 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc 1G Sep 01 02:22:48 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:48 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc 1G" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:48 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:48 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc Sep 01 02:22:48 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:49 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" returned: 0 in 0.298s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:49 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc is being set with open permissions: ugo+rw Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:49 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc Sep 01 02:22:49 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:49 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:49 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info Sep 01 02:22:49 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:49 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info" returned: 0 in 0.248s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:49 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info is being set with open permissions: ugo+rw Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:49 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info Sep 01 02:22:49 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:49 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.info" returned: 0 in 0.247s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:49 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:49 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-a8f501cb-fa72-4541-9f2f-95777aa4a943 tempest-ProjectReaderTests-916938675 None] Create snapshot completed successfully Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-3921a7b4-6af2-4c92-a881-7e37ca0a8cbc-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Lock "cinder-3921a7b4-6af2-4c92-a881-7e37ca0a8cbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-97822bdf-1ff8-46c0-8d53-abad6af08d39" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-97822bdf-1ff8-46c0-8d53-abad6af08d39" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Deleting offline snapshot 3921a7b4-6af2-4c92-a881-7e37ca0a8cbc of volume 97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] snapshot_file for this snap is: volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728399c-b0a6-47de-8d48-a90cb350bc5d]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:50 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc Sep 01 02:22:50 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:50 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" returned: 0 in 0.361s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97822bdf-1ff8-46c0-8d53-abad6af08d39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29781c-638f-4557-8dae-73d53b17f845]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:50 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 Sep 01 02:22:50 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:50 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39" returned: 0 in 0.347s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:50 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:50 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc Sep 01 02:22:50 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:51 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" returned: 0 in 0.388s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:51 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc Sep 01 02:22:51 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:51 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39.3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" returned: 0 in 0.243s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-3921a7b4-6af2-4c92-a881-7e37ca0a8cbc" released by "_delete_snapshot" :: held 1.423s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-97822bdf-1ff8-46c0-8d53-abad6af08d39" released by "delete_snapshot" :: held 1.444s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Created reservations ['9edbc048-7134-42fc-830c-ee703ea641ff', '9fe43c14-bd9a-4ebd-be04-5de9e27494be', 'f6391261-07d7-4358-a0a5-861f46996f20', '2ca74a64-356c-457d-b453-dc803ed35268'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:51 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Delete snapshot completed successfully. Sep 01 02:22:51 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-2bf31649-9b96-4cdf-8581-9d76842329d8 tempest-ProjectReaderTests-916938675 None] Lock "cinder-3921a7b4-6af2-4c92-a881-7e37ca0a8cbc-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-97822bdf-1ff8-46c0-8d53-abad6af08d39-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Lock "cinder-97822bdf-1ff8-46c0-8d53-abad6af08d39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-97822bdf-1ff8-46c0-8d53-abad6af08d39" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-97822bdf-1ff8-46c0-8d53-abad6af08d39" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a879041-9409-4fa2-b328-68dcc06fe5e9]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:52 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 Sep 01 02:22:52 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:52 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39" returned: 0 in 0.342s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:52 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39 Sep 01 02:22:52 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:52 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-97822bdf-1ff8-46c0-8d53-abad6af08d39" returned: 0 in 0.229s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:52 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-97822bdf-1ff8-46c0-8d53-abad6af08d39" released by "delete_volume" :: held 0.625s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Created reservations ['94bffd95-77c5-4763-952d-098ce6863e94', '0dbe652b-903b-4801-a362-5e09b5c73b98', '802b87b8-fdb9-4c2a-adf6-fac71d4f53c3', '5388f90f-3a3f-4daa-b7c2-2a055594ad12'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:53 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:22:53 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:53 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.232s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:53 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Deleted volume successfully. Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-1a387b21-c87c-472b-80cd-3395a62414da tempest-ProjectReaderTests-916938675 None] Lock "cinder-97822bdf-1ff8-46c0-8d53-abad6af08d39-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (267d2db2-5a6e-434b-83ca-b4ed83744dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd09145-1f13-436f-8e42-fafeea1cacab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd09145-1f13-436f-8e42-fafeea1cacab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189961572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfc4480-e7b7-4ad2-97e2-de18bc924eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:54Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1564f498-f87e-41d4-9086-b687cc0e0bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1564f498-f87e-41d4-9086-b687cc0e0bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219e2ce5-3447-43b0-aa23-685447780431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219e2ce5-3447-43b0-aa23-685447780431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfc4480-e7b7-4ad2-97e2-de18bc924eb7', 'volume_name': 'volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c02b15-22f4-4571-8ec2-c55e9f298bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c02b15-22f4-4571-8ec2-c55e9f298bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a659b845-e858-4631-afc6-521abb153d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:53 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Volume 6cfc4480-e7b7-4ad2-97e2-de18bc924eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7', 'volume_size': 1} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189961572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfc4480-e7b7-4ad2-97e2-de18bc924eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec78dcf010940f2a4008a6ba6c1e4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:54Z,use_quota=True,user_id='94284091b9ce4cf49568451f2ab5a338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Creating volume 6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:53 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:22:53 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:53 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 1073741824 Sep 01 02:22:53 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:54 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 1073741824" returned: 0 in 0.378s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:54 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 Sep 01 02:22:54 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:54 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" returned: 0 in 0.267s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a659b845-e858-4631-afc6-521abb153d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acd8ff3-44d6-45b0-a56c-d7ef1cf7323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Volume volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 (6cfc4480-e7b7-4ad2-97e2-de18bc924eb7): created successfully Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acd8ff3-44d6-45b0-a56c-d7ef1cf7323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Flow 'volume_create_manager' (267d2db2-5a6e-434b-83ca-b4ed83744dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:54 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-8bb5a039-4d61-41dd-ae64-fae07142dd83 tempest-ProjectReaderTests-916938675 None] Created volume successfully. Sep 01 02:22:54 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Creating offline snapshot 62510c00-bb04-4b2f-a991-daa07d2f29a3 of volume 6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9e8cc9-8d87-4aa8-939c-e39a7f7dcde3]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:55 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 Sep 01 02:22:55 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:55 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" returned: 0 in 0.346s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 1G {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:55 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 1G Sep 01 02:22:55 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:55 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 1G" returned: 0 in 0.373s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:55 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:55 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 Sep 01 02:22:55 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 -F qcow2 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3" returned: 0 in 0.315s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 is being set with open permissions: ugo+rw Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 Sep 01 02:22:56 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3" returned: 0 in 0.288s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info Sep 01 02:22:56 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info" returned: 0 in 0.265s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87404]: WARNING cinder.volume.drivers.remotefs [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info is being set with open permissions: ugo+rw Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info Sep 01 02:22:56 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.info" returned: 0 in 0.250s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:56 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-04e0d7c3-9bd4-4da8-8315-abb52e96796c tempest-ProjectReaderTests-916938675 None] Create snapshot completed successfully Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-62510c00-bb04-4b2f-a991-daa07d2f29a3-delete_snapshot" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Lock "cinder-62510c00-bb04-4b2f-a991-daa07d2f29a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" by "delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-62510c00-bb04-4b2f-a991-daa07d2f29a3" by "_delete_snapshot" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-62510c00-bb04-4b2f-a991-daa07d2f29a3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Deleting offline snapshot 62510c00-bb04-4b2f-a991-daa07d2f29a3 of volume 6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] snapshot_file for this snap is: volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 {{(pid=87404) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[f958a07c-9eb7-4d31-8a33-1efbbf5857b0]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 Sep 01 02:22:57 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3" returned: 0 in 0.354s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87404) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47cb90f-4c55-4dcd-be1e-830f7193c135]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 Sep 01 02:22:57 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" returned: 0 in 0.358s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:58 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 Sep 01 02:22:58 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:58 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3" returned: 0 in 0.376s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:58 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3 Sep 01 02:22:58 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:58 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7.62510c00-bb04-4b2f-a991-daa07d2f29a3" returned: 0 in 0.250s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-62510c00-bb04-4b2f-a991-daa07d2f29a3" released by "_delete_snapshot" :: held 1.433s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" released by "delete_snapshot" :: held 1.456s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Created reservations ['31e00035-02fa-45dd-8a22-ccca75202c93', 'e3b1e7b4-215c-41fe-87f3-c718dd977225', '9ab79e74-d87d-4d85-8d44-4f88f19e1cf9', '7dbf81cd-1847-4082-9fe0-d7a7d93c3f4d'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:58 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Delete snapshot completed successfully. Sep 01 02:22:58 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-e8fe44d0-ddf0-4a65-b0ae-1bd32c8a6274 tempest-ProjectReaderTests-916938675 None] Lock "cinder-62510c00-bb04-4b2f-a991-daa07d2f29a3-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Lock "cinder-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Acquiring lock "cinder-quobyte-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b3bbe-94f7-4127-8718-5c05f1b8ac35]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 Sep 01 02:22:59 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" returned: 0 in 0.368s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7 Sep 01 02:22:59 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" returned: 0 in 0.267s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Lock "cinder-quobyte-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7" released by "delete_volume" :: held 0.688s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Created reservations ['d54bb42a-5d22-46c5-8dd2-8a71fc650dc7', '55cbd240-2238-4e0d-9bb3-a05d2c99f258', '7c54db4b-93cd-473d-9a0d-28f48faac54f', '107fd55e-592f-4230-8b14-be3aadca5142'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:23:00 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.245s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:00 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Deleted volume successfully. Sep 01 02:23:00 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-d0ae69eb-b511-4a59-88ca-b463e2b849c0 tempest-ProjectReaderTests-916938675 None] Lock "cinder-6cfc4480-e7b7-4ad2-97e2-de18bc924eb7-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Flow 'volume_create_manager' (64bf1b09-6875-4123-8c28-3bd603adffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26654be-c7c9-4473-9c63-700268846493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26654be-c7c9-4473-9c63-700268846493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304355483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6000f17f-3fc4-45de-9527-fed135f08d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530055c98bdb479ca656758bec8e30d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='81f973c79c2343aa9dc69c86f01fc1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834ade3f-3be3-4e0b-ada0-031bc5d4cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834ade3f-3be3-4e0b-ada0-031bc5d4cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f57e47c-524f-4a9e-9744-8cbf0ae844e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f57e47c-524f-4a9e-9744-8cbf0ae844e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6000f17f-3fc4-45de-9527-fed135f08d52', 'volume_name': 'volume-6000f17f-3fc4-45de-9527-fed135f08d52', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f5fc9b-b773-4605-b84c-e483e281087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f5fc9b-b773-4605-b84c-e483e281087f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33f8ee-36c7-47b7-9b25-aafc20e9fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Volume 6000f17f-3fc4-45de-9527-fed135f08d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6000f17f-3fc4-45de-9527-fed135f08d52', 'volume_size': 1} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304355483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6000f17f-3fc4-45de-9527-fed135f08d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530055c98bdb479ca656758bec8e30d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='81f973c79c2343aa9dc69c86f01fc1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Creating volume 6000f17f-3fc4-45de-9527-fed135f08d52 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:04 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 1073741824 Sep 01 02:23:04 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 1073741824" returned: 0 in 0.429s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 Sep 01 02:23:04 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52" returned: 0 in 0.261s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33f8ee-36c7-47b7-9b25-aafc20e9fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6000f17f-3fc4-45de-9527-fed135f08d52', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccef22f5-1dde-438e-b28d-69bbb0cc6593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Volume volume-6000f17f-3fc4-45de-9527-fed135f08d52 (6000f17f-3fc4-45de-9527-fed135f08d52): created successfully Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccef22f5-1dde-438e-b28d-69bbb0cc6593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Flow 'volume_create_manager' (64bf1b09-6875-4123-8c28-3bd603adffdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:05 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-d5503fa2-7862-48b6-8091-e61d8a869f3f tempest-ProjectReaderTests-1201958308 None] Created volume successfully. Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Acquiring lock "cinder-6000f17f-3fc4-45de-9527-fed135f08d52-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Lock "cinder-6000f17f-3fc4-45de-9527-fed135f08d52-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Acquiring lock "cinder-quobyte-6000f17f-3fc4-45de-9527-fed135f08d52" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Lock "cinder-quobyte-6000f17f-3fc4-45de-9527-fed135f08d52" acquired by "delete_volume" :: waited 0.014s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3882a-009d-4445-b94f-242cbe66f38b]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 Sep 01 02:23:05 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52" returned: 0 in 0.348s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52 Sep 01 02:23:05 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-6000f17f-3fc4-45de-9527-fed135f08d52" returned: 0 in 0.236s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Lock "cinder-quobyte-6000f17f-3fc4-45de-9527-fed135f08d52" released by "delete_volume" :: held 0.634s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Created reservations ['51fd1e34-3403-4f3f-9904-e51341dd436f', 'ac411bbc-2728-48e2-93b4-4a9ec259e7a5', '204a7bbf-43c2-490f-9c92-a47d73d2b7eb', 'ced0236e-c365-4c7c-9a37-1615c8e40473'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:23:06 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.226s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:06 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Deleted volume successfully. Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-3528877d-5d68-46e2-adfc-3065251259e9 tempest-ProjectReaderTests-1201958308 None] Lock "cinder-6000f17f-3fc4-45de-9527-fed135f08d52-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87404) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Flow 'volume_create_manager' (8cab157f-60ae-44e1-ace5-dd401d9555f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f97a38a-1ccd-4163-9053-d5b522ee6e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f97a38a-1ccd-4163-9053-d5b522ee6e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542671571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb061ee-ec18-40b9-a1e0-87eef0c51f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530055c98bdb479ca656758bec8e30d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:07Z,use_quota=True,user_id='81f973c79c2343aa9dc69c86f01fc1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d835231-5a11-484f-8719-8becd31c3efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d835231-5a11-484f-8719-8becd31c3efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6a69c9-ab4f-4b6e-8826-4d52517d645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6a69c9-ab4f-4b6e-8826-4d52517d645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb061ee-ec18-40b9-a1e0-87eef0c51f75', 'volume_name': 'volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2832536b-cafb-468d-865f-ff336e0190d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2832536b-cafb-468d-865f-ff336e0190d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db469bd-bdae-4335-bcd3-5afe2e15111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:07 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Volume 8bb061ee-ec18-40b9-a1e0-87eef0c51f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75', 'volume_size': 1} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-542671571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb061ee-ec18-40b9-a1e0-87eef0c51f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530055c98bdb479ca656758bec8e30d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:07Z,use_quota=True,user_id='81f973c79c2343aa9dc69c86f01fc1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587b5929-ffda-4971-827f-a44e745f7d3d),volume_type_id=587b5929-ffda-4971-827f-a44e745f7d3d)}" {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.remotefs [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Creating volume 8bb061ee-ec18-40b9-a1e0-87eef0c51f75 {{(pid=87404) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Selected osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 as target Quobyte volume. {{(pid=87404) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:07 devstack cinder-volume[87404]: INFO cinder.volume.drivers.remotefs [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] casted to osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825 Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 1073741824 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 1073741824 Sep 01 02:23:07 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 1073741824" returned: 0 in 0.399s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 Sep 01 02:23:07 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75" returned: 0 in 0.234s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'} {{(pid=87404) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db469bd-bdae-4335-bcd3-5afe2e15111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75', 'volume_size': 1}' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51c4f6f-d6e9-41f2-9b67-8e3c629e91f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:07 devstack cinder-volume[87404]: INFO cinder.volume.flows.manager.create_volume [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Volume volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 (8bb061ee-ec18-40b9-a1e0-87eef0c51f75): created successfully Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51c4f6f-d6e9-41f2-9b67-8e3c629e91f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87404) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Flow 'volume_create_manager' (8cab157f-60ae-44e1-ace5-dd401d9555f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87404) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:07 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-e6e1cb00-e09a-439e-abf4-77588ebe8aec tempest-ProjectReaderTests-1201958308 None] Created volume successfully. Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Acquiring lock "cinder-8bb061ee-ec18-40b9-a1e0-87eef0c51f75-delete_volume" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:07 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Lock "cinder-8bb061ee-ec18-40b9-a1e0-87eef0c51f75-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Acquiring lock "cinder-quobyte-8bb061ee-ec18-40b9-a1e0-87eef0c51f75" by "delete_volume" {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Lock "cinder-quobyte-8bb061ee-ec18-40b9-a1e0-87eef0c51f75" acquired by "delete_volume" :: waited 0.015s {{(pid=87404) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94b7cd3-1246-43b0-920f-f8e2d7085384]: (4, 'qcow2') {{(pid=88995) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 Sep 01 02:23:08 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75" returned: 0 in 0.336s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75 Sep 01 02:23:08 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be/volume-8bb061ee-ec18-40b9-a1e0-87eef0c51f75" returned: 0 in 0.238s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Lock "cinder-quobyte-8bb061ee-ec18-40b9-a1e0-87eef0c51f75" released by "delete_volume" :: held 0.611s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.quota [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Created reservations ['e9f94d8a-cd37-41c2-b4df-2110224fb04e', '9c263304-071b-4efe-a145-238e684b2723', '1c402d7b-7445-43a0-9487-6e8ba5010b1c', 'd82acba2-1ea9-4db0-b490-2bb165f4b861'] {{(pid=87404) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:23:08 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.227s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:09 devstack cinder-volume[87404]: INFO cinder.volume.manager [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Deleted volume successfully. Sep 01 02:23:09 devstack cinder-volume[87404]: DEBUG cinder.coordination [None req-5875126e-bd12-465f-8046-dbad880b08ea tempest-ProjectReaderTests-1201958308 None] Lock "cinder-8bb061ee-ec18-40b9-a1e0-87eef0c51f75-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87404) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:18 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:INSERT=37,cinder:UPDATE=143,cinder:SELECT=99,cinder:DELETE=11 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:19 devstack cinder-volume[87404]: DEBUG dbcounter [-] [87404] Writing DB stats cinder:SELECT=114,cinder:INSERT=41,cinder:UPDATE=144,cinder:DELETE=12 {{(pid=87404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825': None} {{(pid=87404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG cinder.volume.drivers.quobyte [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99b78ea5-99c9-46eb-8112-f08b8a1b8825'] {{(pid=87404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.lockutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be Sep 01 02:23:28 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_concurrency.processutils [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aec27673f7f8200bb582c584cd8345be" returned: 0 in 0.275s {{(pid=87404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG cinder.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Notifying Schedulers of capabilities ... {{(pid=87404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG oslo_service.periodic_task [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87404) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread count: 28 {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:23:28 devstack cinder-volume[87404]: DEBUG cinder.volume.manager [None req-7420f810-e181-455c-bd1c-14e68f1eb0f1 None None] thread info: [<_MainThread(MainThread, started 135282455994496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87404) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}